Jun 19 04:06:00 devstack cinder-volume[82551]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 04:06:00 devstack cinder-volume[82551]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:06:00 devstack cinder-volume[82551]: we strongly recommend against using it for new projects. Jun 19 04:06:00 devstack cinder-volume[82551]: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:06:00 devstack cinder-volume[82551]: framework. For more detail see Jun 19 04:06:00 devstack cinder-volume[82551]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:06:00 devstack cinder-volume[82551]: import eventlet # noqa Jun 19 04:06:03 devstack cinder-volume[82551]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=82551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:06:03 devstack cinder-volume[82551]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=82551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:06:03 devstack cinder-volume[82551]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=82551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:06:03 devstack cinder-volume[82551]: INFO dbcounter [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Registered counter for database cinder Jun 19 04:06:03 devstack cinder-volume[82551]: DEBUG oslo_db.sqlalchemy.engines [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:04 devstack cinder-volume[82551]: DEBUG dbcounter [-] [82551] Writer thread running {{(pid=82551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:06:04 devstack cinder-volume[82551]: INFO cinder.rpc [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 04:06:04 devstack cinder-volume[82551]: INFO cinder.rpc [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 04:06:04 devstack cinder-volume[82551]: DEBUG oslo_db.sqlalchemy.engines [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:04 devstack cinder-volume[82551]: INFO cinder.volume.manager [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Determined volume DB was empty at startup. Jun 19 04:06:04 devstack cinder-volume[82551]: DEBUG cinder.volume.manager [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=82551) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 04:06:04 devstack cinder-volume[82551]: INFO cinder.volume.manager [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 19 04:06:04 devstack cinder-volume[82551]: WARNING stevedore.named [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:06:04 devstack cinder-volume[82551]: WARNING castellan.key_manager [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:06:04 devstack cinder-volume[82551]: WARNING cinder.keymgr.conf_key_mgr [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:06:04 devstack cinder-volume[82551]: DEBUG cinder.volume.drivers.lvm [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=82551) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jun 19 04:06:04 devstack cinder-volume[82551]: DEBUG oslo_concurrency.processutils [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=82551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:04 devstack cinder-volume[82551]: DEBUG oslo_concurrency.processutils [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] CMD "cinder-rtstool verify" returned: 0 in 0.400s {{(pid=82551) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:04 devstack cinder-volume[82551]: DEBUG oslo_db.sqlalchemy.engines [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:04 devstack cinder-volume[82551]: INFO cinder.rpc [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jun 19 04:06:04 devstack cinder-volume[82551]: INFO cinder.rpc [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jun 19 04:06:04 devstack cinder-volume[82551]: WARNING stevedore.named [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:06:04 devstack cinder-volume[82551]: WARNING castellan.key_manager [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:06:04 devstack cinder-volume[82551]: INFO cinder.volume.manager [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_db.sqlalchemy.engines [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82551) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:05 devstack cinder-volume[82551]: INFO oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Starting 1 workers Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Started child 82730 {{(pid=82551) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Full set of CONF: {{(pid=82551) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] ******************************************************************************** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Configuration options gathered from: {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 04:06:05 devstack cinder-volume[82730]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] ================================================================================ {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] allow_availability_zone_fallback = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] allow_compression_on_image_upload = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] allowed_direct_url_schemes = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] api_rate_limit = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] auth_strategy = keystone {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] az_cache_duration = 3600 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_availability_zone = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_host = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_stats_polling_interval = 60 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backup_api_class = cinder.backup.api.API {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backup_name_template = backup-%s {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backup_use_same_host = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backup_use_temp_snapshot = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] chap_password = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] chap_username = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cinder_internal_tenant_project_id = 5333a7a502f849018d89a80963a6a528 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cinder_internal_tenant_user_id = 877275992df44446bd578786473ba9bc {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cloned_volume_same_az = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cluster = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] compression_format = gzip {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] compute_api_class = cinder.compute.nova.API {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] config_dir = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] config_source = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] control_exchange = openstack {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] debug = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] default_availability_zone = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] default_group_type = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] default_volume_type = lvmdriver-1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] disk_geometry = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] driver_client_cert = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] driver_client_cert_key = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] driver_data_namespace = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] driver_ssl_cert_path = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] driver_ssl_cert_verify = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] driver_use_ssl = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] enable_force_upload = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] enable_new_services = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] enable_unsupported_driver = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] enabled_backends = ['lvmdriver-1'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] enforce_multipath_for_image_xfer = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] filter_function = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_api_insecure = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_api_servers = ['http://192.168.122.84/image'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_api_ssl_compression = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_ca_certificates_file = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_catalog_info = image:glance:publicURL {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_certfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_keyfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_num_retries = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance_request_timeout = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] goodness_function = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] graceful_shutdown_timeout = 5 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] group_api_class = cinder.group.api.API {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] host = devstack {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_compress_on_upload = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_conversion_address_space_limit = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_conversion_cpu_limit = 60 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_conversion_disable = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_upload_use_cinder_backend = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_upload_use_internal_tenant = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_volume_cache_enabled = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_volume_cache_max_count = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] image_volume_cache_max_size_gb = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] init_host_max_objects_retrieval = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] instance_format = [instance: %(uuid)s] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] iscsi_target_flags = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] iscsi_write_cache = on {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] iser_helper = tgtadm {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82730]: INFO cinder.volume.manager [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jun 19 04:06:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] iser_ip_address = 192.168.122.84 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] iser_port = 3260 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] log_color = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] log_config_append = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] log_dir = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] log_file = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] log_options = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] log_rotate_interval = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] log_rotate_interval_type = days {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] log_rotation_type = none {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack sudo[82738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack sudo[82738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] max_age = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] max_logfile_count = 30 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] max_logfile_size_mb = 200 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] max_over_subscription_ratio = 20.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] message_reap_interval = 86400 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] message_ttl = 2592000 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] migration_create_volume_timeout_secs = 300 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] monkey_patch = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] monkey_patch_modules = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] my_ip = 192.168.122.84 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] no_snapshot_gb_quota = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] num_iser_scan_tries = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] num_shell_tries = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] num_volume_device_scan_tries = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] nvmeof_conn_info_version = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] nvmet_ns_id = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] nvmet_port_id = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] osapi_max_limit = 1000 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] osapi_volume_ext_list = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] osapi_volume_listen = 0.0.0.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] osapi_volume_listen_port = 8776 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] osapi_volume_use_ssl = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] osapi_volume_workers = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] per_volume_size_limit = -1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] periodic_fuzzy_delay = 60 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] periodic_interval = 60 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] project_id_regex = [0-9a-f\-]+ {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] public_endpoint = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] publish_errors = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] quota_backup_gigabytes = 1000 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] quota_backups = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] quota_gigabytes = 1000 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] quota_groups = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] quota_snapshots = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] quota_volumes = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] rate_limit_burst = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] rate_limit_except_level = CRITICAL {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] rate_limit_interval = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] reinit_driver_count = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] replication_device = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] report_discard_supported = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] report_interval = 120 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] reservation_clean_interval = 86400 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] reservation_expire = 86400 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] reserved_image_namespaces = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] reserved_percentage = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] rpc_response_timeout = 120 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] run_external_periodic_tasks = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] scst_target_driver = iscsi {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] scst_target_iqn_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_down_time = 720 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] shell_completion = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] snapshot_name_template = snapshot-%s {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] snapshot_same_host = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] split_loggers = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] state_path = /opt/stack/data/cinder {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] storage_availability_zone = nova {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] storage_protocol = iSCSI {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] syslog_log_facility = LOG_USER {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] target_helper = lioadm {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] target_ip_address = 192.168.122.84 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] target_port = 3260 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] target_protocol = iscsi {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] target_secondary_ip_addresses = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] trace_flags = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] transfer_api_class = cinder.transfer.api.API {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] transport_url = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] until_refresh = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] use_chap_auth = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] use_default_quota_class = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] use_journal = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] use_json = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] use_multipath_for_image_xfer = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] use_stderr = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] use_syslog = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] verify_glance_signatures = enabled {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_api_class = cinder.volume.api.API {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_backend_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_clear = zero {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_clear_ionice = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_clear_size = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_copy_bps_limit = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_dd_blocksize = 1M {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_name_template = volume-%s {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_service_inithost_offload = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volume_usage_audit_period = month {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] zoning_mode = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_concurrency.disable_process_locking = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.auth_section = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.auth_type = password {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.auth_version = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.cache = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.certfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.delay_auth_decision = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.040s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.http_connect_timeout = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.include_service_catalog = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.insecure = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.interface = public {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.keyfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_password = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcache_username = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.region_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.service_token_roles_required = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.service_type = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.token_cache_time = 300 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.84/identity {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.backend = dogpile.cache.null {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.backend_argument = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.backend_expiration_time = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.config_prefix = cache.oslo {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.debug_cache_backend = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.enable_retry_client = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.enable_socket_keepalive = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.enabled = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.expiration_time = 600 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.hashclient_retry_attempts = 2 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.memcache_dead_retry = 300 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.memcache_pool_maxsize = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.memcache_sasl_enabled = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.password = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.proxies = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.redis_db = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.redis_sentinel_service_name = mymaster {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.redis_server = localhost:6379 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.retry_attempts = 2 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.retry_delay = 0.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.socket_keepalive_count = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.socket_keepalive_idle = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.socket_keepalive_interval = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.socket_timeout = 1.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.tls_allowed_ciphers = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.tls_cafile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.tls_certfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.tls_enabled = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.tls_keyfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cache.username = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] coordination.backend_url = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.asyncio_connection = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.asyncio_slave_connection = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.backend = sqlalchemy {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.connection = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.connection_debug = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.connection_parameters = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.connection_recycle_time = 3600 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.connection_trace = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.db_inc_retry_interval = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.db_max_retries = 20 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.db_max_retry_interval = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.db_retry_interval = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.max_overflow = 50 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.max_pool_size = 5 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.max_retries = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.mysql_wsrep_sync_wait = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.pool_timeout = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.retry_interval = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.slave_connection = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.sqlite_synchronous = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.synchronous_reader = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] database.use_db_reconnect = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.connection_string = messaging:// {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.enabled = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.es_doc_type = notification {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.es_scroll_size = 10000 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.es_scroll_time = 2m {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.filter_error_trace = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.hmac_keys = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.sentinel_service_name = mymaster {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.socket_timeout = 0.1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.trace_requests = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler.trace_sqlalchemy = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler_jaeger.process_tags = {} {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler_jaeger.service_name_prefix = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] profiler_otlp.service_name_prefix = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.enforce_new_defaults = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: WARNING oslo_config.cfg [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.enforce_scope = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.policy_default_rule = default {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.policy_file = policy.yaml {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_policy.remote_timeout = 60.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] privsep_osbrick.group = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] privsep_osbrick.helper_command = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] privsep_osbrick.user = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cinder_sys_admin.group = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cinder_sys_admin.helper_command = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] cinder_sys_admin.user = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.auth_section = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.auth_type = password {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.cafile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.certfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.collect_timing = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.insecure = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.keyfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.send_service_user_token = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.split_loggers = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] service_user.timeout = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.auth_section = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.auth_type = password {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.certfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.collect_timing = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.insecure = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.keyfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.region_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.split_loggers = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] glance.timeout = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.backend_availability_zone = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.chap_password = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.chap_username = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.disk_geometry = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.driver_client_cert = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.driver_client_cert_key = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.driver_data_namespace = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.driver_use_ssl = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.enable_unsupported_driver = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.extra_capabilities = {} {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.filter_function = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.goodness_function = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:05 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.iscsi_target_flags = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.iscsi_write_cache = on {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.iser_helper = tgtadm {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.iser_ip_address = 192.168.122.84 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.iser_port = 3260 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.lvm_mirrors = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.lvm_share_target = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.lvm_type = auto {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.num_shell_tries = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.nvmet_port_id = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.replication_device = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.report_discard_supported = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.reserved_percentage = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.scst_target_driver = iscsi {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.scst_target_iqn_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.storage_protocol = iSCSI {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.target_helper = tgtadm {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.target_ip_address = 192.168.122.84 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.target_port = 3260 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.target_protocol = iscsi {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.trace_flags = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.unique_fqdn_network = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.use_chap_auth = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volume_backend_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volume_clear = zero {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volume_clear_ionice = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volume_clear_size = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volume_group = cinder-volumes {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack sudo[82738]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_reports.file_event_handler = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_reports.log_dir = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.backend_availability_zone = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.backend_host = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.chap_password = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.chap_username = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.chiscsi_conf = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.disk_geometry = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.driver_client_cert = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack sudo[82858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.driver_data_namespace = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.driver_use_ssl = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack sudo[82858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.extra_capabilities = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.filter_function = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.goodness_function = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.iser_helper = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.iser_ip_address = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.iser_port = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.iser_target_prefix = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.lvm_conf_file = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.lvm_mirrors = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.lvm_share_target = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.lvm_type = auto {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.num_shell_tries = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.nvmet_port_id = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.replication_device = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.report_discard_supported = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.reserved_percentage = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.scst_target_driver = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.storage_protocol = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.target_helper = lioadm {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.target_ip_address = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.target_port = 3260 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.target_protocol = iscsi {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.trace_flags = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.use_chap_auth = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volume_clear = zero {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volume_clear_size = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] lvmdriver-1.volumes_dir = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.ssl = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.ssl_version = {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_notifications.driver = [] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_notifications.retry = -1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] oslo_messaging_notifications.transport_url = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] key_manager.fixed_key = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.barbican_api_version = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.barbican_endpoint = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.barbican_endpoint_type = public {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.barbican_region_name = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.cafile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.certfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.collect_timing = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.insecure = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.keyfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.number_of_retries = 60 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.retry_delay = 1 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.send_service_user_token = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.split_loggers = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.timeout = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.verify_ssl = True {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican.verify_ssl_path = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican_service_user.auth_section = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican_service_user.auth_type = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican_service_user.cafile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican_service_user.certfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican_service_user.collect_timing = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican_service_user.insecure = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican_service_user.keyfile = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican_service_user.split_loggers = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] barbican_service_user.timeout = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.approle_role_id = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.approle_secret_id = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.kv_mountpoint = secret {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.kv_path = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.kv_version = 2 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.namespace = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.root_token_id = **** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.ssl_ca_crt_file = None {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.timeout = 60.0 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.use_ssl = False {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:06:06 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] ******************************************************************************** {{(pid=82551) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 04:06:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.806s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:06 devstack sudo[82858]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.682s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:06:06 devstack cinder-volume[82730]: INFO cinder.brick.local_dev.lvm [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jun 19 04:06:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:06 devstack sudo[83108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:06 devstack sudo[83108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:07 devstack sudo[83108]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:07 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.704s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:07 devstack cinder-volume[82730]: DEBUG cinder.brick.local_dev.lvm [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=82730) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jun 19 04:06:07 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:07 devstack sudo[83301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:07 devstack sudo[83301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:08 devstack sudo[83301]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:08 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.035s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:08 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:08 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.038s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:08 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:08 devstack sudo[83496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:08 devstack sudo[83496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:09 devstack sudo[83496]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:09 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.719s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:09 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:09 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:09 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:09 devstack sudo[83518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jun 19 04:06:09 devstack sudo[83518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:09 devstack sudo[83518]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:09 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.659s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:09 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:09 devstack sudo[83522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:09 devstack sudo[83522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:10 devstack sudo[83522]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:10 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.679s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:10 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:10 devstack sudo[83530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:10 devstack sudo[83530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:11 devstack sudo[83530]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:11 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.686s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:11 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:11 devstack sudo[83540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:11 devstack sudo[83540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:12 devstack sudo[83540]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:12 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.788s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:12 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:12 devstack sudo[83545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:12 devstack sudo[83545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:12 devstack sudo[83545]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:12 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.804s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:12 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:12 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.016s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:12 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:12 devstack sudo[83550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:12 devstack sudo[83550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:13 devstack sudo[83550]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:13 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.724s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:13 devstack cinder-volume[82730]: INFO cinder.volume.drivers.lvm [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jun 19 04:06:13 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:13 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:13 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:13 devstack sudo[83556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:13 devstack sudo[83556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:14 devstack sudo[83556]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:14 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.798s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:14 devstack cinder-volume[82730]: DEBUG cinder.volume.drivers.lvm [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Updating volume stats {{(pid=82730) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:06:14 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:14 devstack sudo[83643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:14 devstack sudo[83643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:15 devstack cinder-volume[82551]: DEBUG dbcounter [-] [82551] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=82551) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:06:15 devstack sudo[83643]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:15 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:15 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:15 devstack sudo[83789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:15 devstack sudo[83789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:15 devstack sudo[83789]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:15 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:15 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:15 devstack sudo[83827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:15 devstack sudo[83827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:16 devstack sudo[83827]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:16 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.645s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:16 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:16 devstack sudo[83830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:16 devstack sudo[83830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:17 devstack sudo[83830]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.637s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:17 devstack cinder-volume[82730]: INFO cinder.volume.driver [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Driver hasn't implemented _init_vendor_properties() Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG cinder.volume.driver [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=82730) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG oslo_db.sqlalchemy.engines [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=82730) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG dbcounter [-] [82730] Writer thread running {{(pid=82730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG cinder.db.api [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Building query based on filter {{(pid=82730) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG cinder.image.image_utils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=82730) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 04:06:17 devstack cinder-volume[82730]: INFO cinder.keymgr.migration [None req-f4ebdf50-e734-45a6-a6c4-ec1fe92d328a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG cinder.volume.drivers.lvm [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Updating volume stats {{(pid=82730) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:17 devstack sudo[83834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:17 devstack sudo[83834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:17 devstack sudo[83834]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:17 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:17 devstack sudo[83838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:17 devstack sudo[83838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:18 devstack sudo[83838]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:18 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.690s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:18 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:18 devstack sudo[83844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:18 devstack sudo[83844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:19 devstack sudo[83844]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:19 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.628s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:19 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:19 devstack sudo[83848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:19 devstack sudo[83848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:19 devstack sudo[83848]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:19 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.672s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:19 devstack cinder-volume[82730]: DEBUG cinder.manager [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Notifying Schedulers of capabilities ... {{(pid=82730) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:06:19 devstack cinder-volume[82730]: INFO cinder.volume.manager [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Driver initialization completed successfully. Jun 19 04:06:19 devstack cinder-volume[82730]: INFO cinder.manager [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Initiating service 2 cleanup Jun 19 04:06:20 devstack cinder-volume[82730]: INFO cinder.manager [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Service 2 cleanup completed. Jun 19 04:06:20 devstack cinder-volume[82730]: DEBUG cinder.service [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Creating RPC server for service cinder-volume {{(pid=82730) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 04:06:20 devstack cinder-volume[82730]: DEBUG cinder.service [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=82730) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 04:06:20 devstack cinder-volume[82730]: INFO cinder.volume.manager [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jun 19 04:06:20 devstack cinder-volume[82730]: DEBUG cinder.volume.drivers.lvm [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Updating volume stats {{(pid=82730) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:06:20 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:20 devstack sudo[83853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:06:20 devstack sudo[83853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:20 devstack sudo[83853]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:20 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:20 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:20 devstack sudo[83857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:20 devstack sudo[83857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:21 devstack sudo[83857]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:21 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.651s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:21 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:21 devstack sudo[83860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:06:21 devstack sudo[83860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:22 devstack sudo[83860]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:22 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.655s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:22 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:06:22 devstack sudo[83920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:06:22 devstack sudo[83920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:06:22 devstack sudo[83920]: pam_unix(sudo:session): session closed for user root Jun 19 04:06:22 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:06:22 devstack cinder-volume[82730]: INFO cinder.volume.manager [None req-16adbd59-8e08-44be-bcf9-81e15fd38661 None None] Driver post RPC initialization completed successfully. Jun 19 04:06:32 devstack cinder-volume[82730]: DEBUG dbcounter [-] [82730] Writing DB stats cinder:SELECT=3 {{(pid=82730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:06:32 devstack cinder-volume[82730]: DEBUG dbcounter [-] [82730] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=82730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:07:03 devstack cinder-volume[82730]: DEBUG oslo_service.periodic_task [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running periodic task VolumeManager._thread_info {{(pid=82730) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:07:03 devstack cinder-volume[82730]: DEBUG cinder.volume.manager [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] thread count: 6 {{(pid=82730) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:07:03 devstack cinder-volume[82730]: DEBUG cinder.volume.manager [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] thread info: [<_MainThread(MainThread, started 130974181322880)>, , , , , ] {{(pid=82730) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:08:03 devstack cinder-volume[82730]: DEBUG oslo_service.periodic_task [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82730) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:08:03 devstack cinder-volume[82730]: DEBUG cinder.volume.drivers.lvm [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Updating volume stats {{(pid=82730) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:08:03 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:03 devstack sudo[88762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:08:03 devstack sudo[88762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:04 devstack sudo[88762]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:04 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.605s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:04 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:04 devstack sudo[88765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:08:04 devstack sudo[88765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:04 devstack sudo[88765]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:04 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.600s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:04 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:05 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:08:05 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:05 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.613s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:08:05 devstack sudo[88771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:08:05 devstack sudo[88771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:08:06 devstack sudo[88771]: pam_unix(sudo:session): session closed for user root Jun 19 04:08:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.622s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:08:06 devstack cinder-volume[82730]: DEBUG cinder.manager [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Notifying Schedulers of capabilities ... {{(pid=82730) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:08:06 devstack cinder-volume[82730]: DEBUG oslo_service.periodic_task [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running periodic task VolumeManager._thread_info {{(pid=82730) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:08:06 devstack cinder-volume[82730]: DEBUG cinder.volume.manager [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] thread count: 6 {{(pid=82730) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:08:06 devstack cinder-volume[82730]: DEBUG cinder.volume.manager [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] thread info: [<_MainThread(MainThread, started 130974181322880)>, , , , , ] {{(pid=82730) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:08:32 devstack cinder-volume[82730]: DEBUG dbcounter [-] [82730] Writing DB stats cinder:SELECT=1 {{(pid=82730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:08:32 devstack cinder-volume[82730]: DEBUG dbcounter [-] [82730] Writing DB stats cinder:UPDATE=1 {{(pid=82730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:09:03 devstack cinder-volume[82730]: DEBUG oslo_service.periodic_task [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82730) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:09:03 devstack cinder-volume[82730]: DEBUG cinder.volume.drivers.lvm [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Updating volume stats {{(pid=82730) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:09:03 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:03 devstack sudo[89231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:09:03 devstack sudo[89231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:04 devstack sudo[89231]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:04 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.646s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:04 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:04 devstack sudo[89234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:09:04 devstack sudo[89234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:05 devstack sudo[89234]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.624s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:05 devstack sudo[89488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:09:05 devstack sudo[89488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:05 devstack sudo[89488]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.616s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:09:05 devstack sudo[89501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:09:05 devstack sudo[89501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:09:06 devstack sudo[89501]: pam_unix(sudo:session): session closed for user root Jun 19 04:09:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:09:06 devstack cinder-volume[82730]: DEBUG cinder.manager [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Notifying Schedulers of capabilities ... {{(pid=82730) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:09:06 devstack cinder-volume[82730]: DEBUG oslo_service.periodic_task [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running periodic task VolumeManager._thread_info {{(pid=82730) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:09:06 devstack cinder-volume[82730]: DEBUG cinder.volume.manager [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] thread count: 6 {{(pid=82730) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:09:06 devstack cinder-volume[82730]: DEBUG cinder.volume.manager [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] thread info: [<_MainThread(MainThread, started 130974181322880)>, , , , , ] {{(pid=82730) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:10:03 devstack cinder-volume[82730]: DEBUG oslo_service.periodic_task [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=82730) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:10:03 devstack cinder-volume[82730]: DEBUG cinder.volume.drivers.lvm [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Updating volume stats {{(pid=82730) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jun 19 04:10:03 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:03 devstack sudo[91520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jun 19 04:10:03 devstack sudo[91520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:04 devstack sudo[91520]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:04 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.659s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:04 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:04 devstack sudo[91534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:10:04 devstack sudo[91534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:05 devstack sudo[91534]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.615s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:05 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jun 19 04:10:05 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:05 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.606s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:05 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:10:05 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jun 19 04:10:05 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:10:06 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Jun 19 04:10:06 devstack cinder-volume[82730]: DEBUG oslo_concurrency.processutils [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.612s {{(pid=82730) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:10:06 devstack cinder-volume[82730]: DEBUG cinder.manager [None req-9f4d584b-0b83-48ea-aec9-cd88185f6630 None None] Notifying Schedulers of capabilities ... {{(pid=82730) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:10:32 devstack cinder-volume[82730]: DEBUG dbcounter [-] [82730] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=82730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:10:59 devstack cinder-volume[82551]: INFO oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Caught SIGTERM, stopping children Jun 19 04:10:59 devstack cinder-volume[82551]: DEBUG oslo_concurrency.lockutils [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Acquiring lock "singleton_lock" {{(pid=82551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:10:59 devstack cinder-volume[82551]: DEBUG oslo_concurrency.lockutils [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Acquired lock "singleton_lock" {{(pid=82551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:10:59 devstack cinder-volume[82551]: DEBUG oslo_concurrency.lockutils [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Releasing lock "singleton_lock" {{(pid=82551) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:10:59 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Stop services. {{(pid=82551) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 19 04:10:59 devstack cinder-volume[82551]: DEBUG oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Killing children. {{(pid=82551) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 19 04:10:59 devstack cinder-volume[82551]: INFO oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Waiting on 1 children to exit Jun 19 04:11:00 devstack cinder-volume[82730]: DEBUG oslo_concurrency.lockutils [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Acquiring lock "singleton_lock" {{(pid=82730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:00 devstack cinder-volume[82730]: DEBUG oslo_concurrency.lockutils [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Acquired lock "singleton_lock" {{(pid=82730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:00 devstack cinder-volume[82730]: DEBUG oslo_concurrency.lockutils [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Releasing lock "singleton_lock" {{(pid=82730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:00 devstack cinder-volume[82730]: WARNING amqp [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:11:00 devstack cinder-volume[82730]: WARNING amqp [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jun 19 04:11:00 devstack cinder-volume[82551]: INFO oslo_service.backend._eventlet.service [None req-d2722ccc-3a4c-4e62-bcf9-7cb28b14fbb1 None None] Child 82730 exited with status 0 Jun 19 04:11:00 devstack cinder-volume[92905]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 04:11:00 devstack cinder-volume[92905]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:11:00 devstack cinder-volume[92905]: we strongly recommend against using it for new projects. Jun 19 04:11:00 devstack cinder-volume[92905]: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:11:00 devstack cinder-volume[92905]: framework. For more detail see Jun 19 04:11:00 devstack cinder-volume[92905]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:11:00 devstack cinder-volume[92905]: import eventlet # noqa Jun 19 04:11:02 devstack cinder-volume[92905]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=92905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:02 devstack cinder-volume[92905]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=92905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:02 devstack cinder-volume[92905]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=92905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:03 devstack cinder-volume[92905]: INFO dbcounter [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Registered counter for database cinder Jun 19 04:11:03 devstack cinder-volume[92905]: DEBUG oslo_db.sqlalchemy.engines [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92905) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG dbcounter [-] [92905] Writer thread running {{(pid=92905) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:11:04 devstack cinder-volume[92905]: INFO cinder.rpc [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 04:11:04 devstack cinder-volume[92905]: INFO cinder.rpc [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_db.sqlalchemy.engines [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92905) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:04 devstack cinder-volume[92905]: INFO cinder.volume.manager [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Determined volume DB was empty at startup. Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG cinder.volume.manager [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Cinder Volume DB check: vol_db_empty=True {{(pid=92905) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 04:11:04 devstack cinder-volume[92905]: INFO cinder.volume.manager [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Service not found for updating active_backend_id, assuming default for driver init. Jun 19 04:11:04 devstack cinder-volume[92905]: WARNING stevedore.named [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:11:04 devstack cinder-volume[92905]: WARNING castellan.key_manager [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:11:04 devstack cinder-volume[92905]: WARNING cinder.keymgr.conf_key_mgr [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:11:04 devstack cinder-volume[92905]: INFO cinder.volume.manager [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_db.sqlalchemy.engines [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=92905) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:04 devstack cinder-volume[92905]: INFO oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Starting 1 workers Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Started child 93188 {{(pid=92905) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Full set of CONF: {{(pid=92905) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] ******************************************************************************** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Configuration options gathered from: {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] ================================================================================ {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] allow_availability_zone_fallback = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] allow_compression_on_image_upload = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] allowed_direct_url_schemes = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] api_rate_limit = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] auth_strategy = keystone {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_availability_zone = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_host = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_stats_polling_interval = 60 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backup_api_class = cinder.backup.api.API {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backup_name_template = backup-%s {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backup_use_same_host = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backup_use_temp_snapshot = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] chap_password = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] chap_username = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cinder_internal_tenant_project_id = 5333a7a502f849018d89a80963a6a528 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cinder_internal_tenant_user_id = 877275992df44446bd578786473ba9bc {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cluster = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] compression_format = gzip {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] compute_api_class = cinder.compute.nova.API {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[93188]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] config_dir = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] config_source = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] control_exchange = openstack {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] debug = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] default_availability_zone = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] default_group_type = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] default_volume_type = QuobyteHD {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] disk_geometry = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] driver_client_cert = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] driver_client_cert_key = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] driver_data_namespace = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] driver_ssl_cert_path = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] driver_ssl_cert_verify = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] driver_use_ssl = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] enable_new_services = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] enable_unsupported_driver = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] enabled_backends = ['QuobyteHD'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] enforce_multipath_for_image_xfer = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] filter_function = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_api_insecure = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_api_servers = ['http://192.168.122.84/image'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_api_ssl_compression = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_ca_certificates_file = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_catalog_info = image:glance:publicURL {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_certfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_keyfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_num_retries = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance_request_timeout = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] goodness_function = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] graceful_shutdown_timeout = 5 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] group_api_class = cinder.group.api.API {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] host = devstack {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_compress_on_upload = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_conversion_address_space_limit = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_conversion_cpu_limit = 60 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_conversion_disable = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_upload_use_cinder_backend = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_upload_use_internal_tenant = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_volume_cache_enabled = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_volume_cache_max_count = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] image_volume_cache_max_size_gb = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] init_host_max_objects_retrieval = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] instance_format = [instance: %(uuid)s] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] iscsi_target_flags = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] iscsi_write_cache = on {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] iser_helper = tgtadm {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] iser_ip_address = 192.168.122.84 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] iser_port = 3260 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] log_color = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] log_config_append = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] log_dir = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] log_file = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] log_options = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] log_rotate_interval = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] log_rotate_interval_type = days {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] log_rotation_type = none {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] max_age = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] max_logfile_count = 30 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] max_logfile_size_mb = 200 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] max_over_subscription_ratio = 20.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] message_reap_interval = 86400 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] message_ttl = 2592000 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] migration_create_volume_timeout_secs = 300 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] monkey_patch = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] monkey_patch_modules = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] my_ip = 192.168.122.84 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] no_snapshot_gb_quota = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] num_iser_scan_tries = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] num_shell_tries = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] num_volume_device_scan_tries = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] nvmeof_conn_info_version = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] nvmet_ns_id = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] nvmet_port_id = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] osapi_max_limit = 1000 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] osapi_volume_ext_list = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] osapi_volume_listen = 0.0.0.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] osapi_volume_listen_port = 8776 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] osapi_volume_use_ssl = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] osapi_volume_workers = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] per_volume_size_limit = -1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] periodic_fuzzy_delay = 60 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] periodic_interval = 60 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] project_id_regex = [0-9a-f\-]+ {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] public_endpoint = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] publish_errors = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] quota_backup_gigabytes = 1000 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] quota_backups = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] quota_gigabytes = 1000 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] quota_groups = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] quota_snapshots = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] quota_volumes = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] rate_limit_burst = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] rate_limit_except_level = CRITICAL {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] rate_limit_interval = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] reinit_driver_count = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] replication_device = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] report_discard_supported = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] report_interval = 120 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] reservation_clean_interval = 86400 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] reservation_expire = 86400 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] reserved_image_namespaces = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] reserved_percentage = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] rpc_response_timeout = 120 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] run_external_periodic_tasks = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] scst_target_driver = iscsi {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] scst_target_iqn_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_down_time = 720 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] shell_completion = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] snapshot_name_template = snapshot-%s {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] split_loggers = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] state_path = /opt/stack/data/cinder {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] storage_availability_zone = nova {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] storage_protocol = iSCSI {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] syslog_log_facility = LOG_USER {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] target_helper = lioadm {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] target_ip_address = 192.168.122.84 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] target_port = 3260 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] target_protocol = iscsi {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] target_secondary_ip_addresses = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] trace_flags = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] transfer_api_class = cinder.transfer.api.API {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] transport_url = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] until_refresh = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] use_chap_auth = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] use_default_quota_class = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] use_journal = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] use_json = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] use_multipath_for_image_xfer = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] use_stderr = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] use_syslog = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] verify_glance_signatures = enabled {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_api_class = cinder.volume.api.API {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_backend_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_clear = zero {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_clear_ionice = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_clear_size = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_copy_bps_limit = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_dd_blocksize = 1M {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_name_template = volume-%s {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_service_inithost_offload = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volume_usage_audit_period = month {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] zoning_mode = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_concurrency.disable_process_locking = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] os_brick.lightos_discovery_client_address = localhost {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] os_brick.wait_mpath_device_interval = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.auth_section = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.auth_type = password {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.auth_version = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.cache = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.certfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.delay_auth_decision = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.http_connect_timeout = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.include_service_catalog = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.insecure = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.interface = public {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.keyfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_password = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_secret_key = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_security_strategy = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcache_username = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.region_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.service_token_roles_required = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.service_type = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.token_cache_time = 300 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.84/identity {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.backend = dogpile.cache.null {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.backend_argument = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.backend_expiration_time = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.config_prefix = cache.oslo {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.debug_cache_backend = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.enable_retry_client = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.enable_socket_keepalive = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.enabled = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.expiration_time = 600 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.hashclient_dead_timeout = 60.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.hashclient_retry_attempts = 2 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.hashclient_retry_timeout = 1.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.memcache_dead_retry = 300 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.memcache_pool_maxsize = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.memcache_pool_unused_timeout = 60 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.memcache_sasl_enabled = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.memcache_servers = ['localhost:11211'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.password = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.proxies = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.redis_db = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.redis_sentinel_service_name = mymaster {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.redis_server = localhost:6379 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.retry_attempts = 2 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.retry_delay = 0.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.socket_keepalive_count = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.socket_keepalive_idle = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.socket_keepalive_interval = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.socket_timeout = 1.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.tls_allowed_ciphers = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.tls_cafile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.tls_certfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.tls_enabled = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.tls_keyfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cache.username = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] coordination.backend_url = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.asyncio_connection = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.asyncio_slave_connection = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.backend = sqlalchemy {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[93188]: INFO cinder.volume.manager [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.connection = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.remotefs [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93188) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.connection_debug = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.connection_parameters = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.connection_recycle_time = 3600 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.connection_trace = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.db_inc_retry_interval = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.db_max_retries = 20 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.db_max_retry_interval = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.db_retry_interval = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.max_overflow = 50 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.max_pool_size = 5 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.max_retries = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.mysql_sql_mode = TRADITIONAL {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.mysql_wsrep_sync_wait = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.pool_timeout = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.retry_interval = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.slave_connection = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.sqlite_synchronous = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.synchronous_reader = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] database.use_db_reconnect = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_metrics.metrics_process_name = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.connection_string = messaging:// {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.enabled = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.es_doc_type = notification {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.es_scroll_size = 10000 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.es_scroll_time = 2m {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.filter_error_trace = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.hmac_keys = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.sentinel_service_name = mymaster {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.socket_timeout = 0.1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.trace_requests = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler.trace_sqlalchemy = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler_jaeger.process_tags = {} {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler_jaeger.service_name_prefix = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] profiler_otlp.service_name_prefix = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.enforce_new_defaults = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: WARNING oslo_config.cfg [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.enforce_scope = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.policy_default_rule = default {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.policy_file = policy.yaml {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_policy.remote_timeout = 60.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] privsep_osbrick.capabilities = [21, 2] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] privsep_osbrick.group = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] privsep_osbrick.helper_command = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] privsep_osbrick.log_daemon_traceback = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] privsep_osbrick.thread_pool_size = 4 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] privsep_osbrick.user = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cinder_sys_admin.group = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cinder_sys_admin.helper_command = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] cinder_sys_admin.user = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.auth_section = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.auth_type = password {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.cafile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.certfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.collect_timing = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.insecure = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.keyfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.send_service_user_token = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.split_loggers = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] service_user.timeout = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.auth_section = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.auth_type = password {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.certfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.collect_timing = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.insecure = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.keyfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.region_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.split_loggers = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] glance.timeout = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.backend_availability_zone = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.chap_password = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.chap_username = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.disk_geometry = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.driver_client_cert = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.driver_client_cert_key = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.driver_data_namespace = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.driver_ssl_cert_path = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.driver_use_ssl = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.enable_unsupported_driver = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.extra_capabilities = {} {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.filter_function = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.goodness_function = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.image_volume_cache_enabled = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.iscsi_target_flags = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.iscsi_write_cache = on {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.iser_helper = tgtadm {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.iser_ip_address = 192.168.122.84 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.iser_port = 3260 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_host = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_login = admin {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_mount_options = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_password = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_private_key = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_secure_file_operations = auto {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_share_path = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_ssh_port = 22 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nas_volume_prov_type = thin {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.num_shell_tries = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nvmet_ns_id = 10 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.nvmet_port_id = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.quobyte_client_cfg = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.quobyte_volume_url = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.replication_device = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.report_discard_supported = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.reserved_percentage = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.scst_target_driver = iscsi {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.scst_target_iqn_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.storage_protocol = iSCSI {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.target_helper = tgtadm {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.target_ip_address = 192.168.122.84 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.target_port = 3260 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.target_protocol = iscsi {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.trace_flags = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.unique_fqdn_network = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.use_chap_auth = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.volume_backend_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.volume_clear = zero {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.volume_clear_ionice = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.volume_clear_size = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_reports.file_event_handler = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_reports.file_event_handler_interval = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_reports.log_dir = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.backend_availability_zone = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.backend_host = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.chap_password = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.chap_username = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.chiscsi_conf = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.disk_geometry = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.driver_client_cert = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.driver_client_cert_key = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.driver_data_namespace = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.driver_use_ssl = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.enable_unsupported_driver = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.extra_capabilities = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.filter_function = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.goodness_function = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.iscsi_target_flags = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.iscsi_write_cache = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.iser_helper = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.iser_ip_address = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.iser_port = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.iser_target_prefix = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_host = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_login = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_mount_options = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_password = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_private_key = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_secure_file_operations = false {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_share_path = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_ssh_port = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nas_volume_prov_type = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.num_iser_scan_tries = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.num_shell_tries = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nvmet_ns_id = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.nvmet_port_id = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.replication_device = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.report_discard_supported = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.reserved_percentage = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.scst_target_driver = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.scst_target_iqn_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.storage_protocol = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.target_helper = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.target_ip_address = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.target_port = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.target_prefix = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.target_protocol = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.trace_flags = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.unique_fqdn_network = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.use_chap_auth = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.volume_clear = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.volume_clear_ionice = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.volume_clear_size = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.volume_dd_blocksize = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] QuobyteHD.volumes_dir = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.hostname = devstack {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.ssl = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.ssl_version = {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_notifications.driver = [] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_notifications.retry = -1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] oslo_messaging_notifications.transport_url = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] key_manager.fixed_key = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.barbican_api_version = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.barbican_endpoint = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.barbican_endpoint_type = public {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.barbican_region_name = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.cafile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.certfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.collect_timing = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.insecure = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.keyfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.number_of_retries = 60 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.retry_delay = 1 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.send_service_user_token = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.split_loggers = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.timeout = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.verify_ssl = True {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican.verify_ssl_path = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican_service_user.auth_section = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican_service_user.auth_type = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican_service_user.cafile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican_service_user.certfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican_service_user.collect_timing = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican_service_user.insecure = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican_service_user.keyfile = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican_service_user.split_loggers = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] barbican_service_user.timeout = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.approle_role_id = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.approle_secret_id = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.kv_mountpoint = secret {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.kv_path = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.kv_version = 2 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.namespace = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.root_token_id = **** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.ssl_ca_crt_file = None {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.timeout = 60.0 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.use_ssl = False {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:04 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] ******************************************************************************** {{(pid=92905) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 04:11:04 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93188) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 19 04:11:04 devstack cinder-volume[93188]: WARNING cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 19 04:11:04 devstack cinder-volume[93188]: WARNING cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 19 04:11:04 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Running cmd (subprocess): mount.quobyte {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:04 devstack quobyte-client[93189]: Reading configuration file: /etc/quobyte/client.cfg Jun 19 04:11:04 devstack quobyte-client[93189]: Invalid parameters found, error: missing mount point. Jun 19 04:11:04 devstack quobyte-client[93189]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 19 04:11:04 devstack quobyte-client[93189]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 19 04:11:04 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] CMD "mount.quobyte" returned: 1 in 0.073s {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:04 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:04 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:04 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:04 devstack cinder-volume[93188]: INFO cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c ... Jun 19 04:11:04 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 -c /etc/quobyte/client-cinder.cfg {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:04 devstack sudo[93190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 -c /etc/quobyte/client-cinder.cfg Jun 19 04:11:04 devstack sudo[93190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:05 devstack sudo[93190]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:05 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.796s {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:05 devstack cinder-volume[93188]: INFO cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c succeeded Jun 19 04:11:05 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:05 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.815s {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:05 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:05 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:11:05 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:06 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.620s {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:06 devstack cinder-volume[93188]: INFO cinder.volume.driver [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Driver hasn't implemented _init_vendor_properties() Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG cinder.volume.driver [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93188) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG oslo_db.sqlalchemy.engines [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93188) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG dbcounter [-] [93188] Writer thread running {{(pid=93188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG cinder.db.api [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Building query based on filter {{(pid=93188) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG cinder.image.image_utils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93188) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 04:11:06 devstack cinder-volume[93188]: INFO cinder.keymgr.migration [None req-bfd31e80-5525-4220-b3f0-2aa9ec30db58 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:06 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:11:06 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:06 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.614s {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:06 devstack cinder-volume[93188]: DEBUG cinder.manager [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Notifying Schedulers of capabilities ... {{(pid=93188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:11:07 devstack cinder-volume[93188]: INFO cinder.volume.manager [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Driver initialization completed successfully. Jun 19 04:11:07 devstack cinder-volume[93188]: INFO cinder.manager [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Initiating service 3 cleanup Jun 19 04:11:07 devstack cinder-volume[93188]: INFO cinder.manager [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Service 3 cleanup completed. Jun 19 04:11:07 devstack cinder-volume[93188]: DEBUG cinder.service [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Creating RPC server for service cinder-volume {{(pid=93188) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 04:11:07 devstack cinder-volume[93188]: DEBUG cinder.service [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93188) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 04:11:07 devstack cinder-volume[93188]: INFO cinder.volume.manager [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 19 04:11:07 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:07 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:07 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:07 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.quobyte [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:07 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:07 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:07 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:11:07 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:07 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:07 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.699s {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:07 devstack cinder-volume[93188]: INFO cinder.volume.manager [None req-59e601fc-de09-4981-a754-9394f1e5db43 None None] Driver post RPC initialization completed successfully. Jun 19 04:11:11 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-57539615-76ed-48df-9347-536f6752224a None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:11 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-57539615-76ed-48df-9347-536f6752224a None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:11 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.quobyte [None req-57539615-76ed-48df-9347-536f6752224a None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93188) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:11 devstack cinder-volume[93188]: DEBUG cinder.volume.drivers.quobyte [None req-57539615-76ed-48df-9347-536f6752224a None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93188) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:11 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-57539615-76ed-48df-9347-536f6752224a None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93188) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:11 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-57539615-76ed-48df-9347-536f6752224a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:11 devstack sudo[93438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:11:11 devstack sudo[93438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:12 devstack sudo[93438]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:12 devstack cinder-volume[93188]: DEBUG oslo_concurrency.processutils [None req-57539615-76ed-48df-9347-536f6752224a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.582s {{(pid=93188) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:12 devstack cinder-volume[93188]: DEBUG cinder.manager [None req-57539615-76ed-48df-9347-536f6752224a None None] Notifying Schedulers of capabilities ... {{(pid=93188) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:11:14 devstack cinder-volume[92905]: DEBUG dbcounter [-] [92905] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=92905) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:15 devstack cinder-volume[92905]: INFO oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Caught SIGTERM, stopping children Jun 19 04:11:15 devstack cinder-volume[92905]: DEBUG oslo_concurrency.lockutils [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Acquiring lock "singleton_lock" {{(pid=92905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:15 devstack cinder-volume[92905]: DEBUG oslo_concurrency.lockutils [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Acquired lock "singleton_lock" {{(pid=92905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:15 devstack cinder-volume[92905]: DEBUG oslo_concurrency.lockutils [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Releasing lock "singleton_lock" {{(pid=92905) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:15 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Stop services. {{(pid=92905) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jun 19 04:11:15 devstack cinder-volume[92905]: DEBUG oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Killing children. {{(pid=92905) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jun 19 04:11:15 devstack cinder-volume[92905]: INFO oslo_service.backend._eventlet.service [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Waiting on 1 children to exit Jun 19 04:11:17 devstack cinder-volume[93188]: DEBUG dbcounter [-] [93188] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=93188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:17 devstack cinder-volume[93188]: DEBUG dbcounter [-] [93188] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=93188) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:20 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Acquiring lock "singleton_lock" {{(pid=93188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:20 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Acquired lock "singleton_lock" {{(pid=93188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:20 devstack cinder-volume[93188]: DEBUG oslo_concurrency.lockutils [None req-e41df479-60d9-4076-9bf5-d7c5f7f803fb None None] Releasing lock "singleton_lock" {{(pid=93188) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:20 devstack cinder-volume[93188]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Jun 19 04:11:20 devstack cinder-volume[93188]: Exception ignored in: Jun 19 04:11:20 devstack cinder-volume[93188]: Traceback (most recent call last): Jun 19 04:11:20 devstack cinder-volume[93188]: File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/common.py", line 467, in __del__ Jun 19 04:11:20 devstack cinder-volume[93188]: File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/common.py", line 457, in _done Jun 19 04:11:20 devstack cinder-volume[93188]: File "/usr/lib/python3.12/logging/__init__.py", line 1526, in debug Jun 19 04:11:20 devstack cinder-volume[93188]: File "/usr/lib/python3.12/logging/__init__.py", line 1800, in isEnabledFor Jun 19 04:11:20 devstack cinder-volume[93188]: File "/usr/lib/python3.12/logging/__init__.py", line 241, in _acquireLock Jun 19 04:11:20 devstack cinder-volume[93188]: File "/usr/lib/python3.12/threading.py", line 198, in acquire Jun 19 04:11:20 devstack cinder-volume[93188]: File "/opt/stack/data/venv/lib/python3.12/site-packages/eventlet/green/thread.py", line 39, in get_ident Jun 19 04:11:20 devstack cinder-volume[93188]: RuntimeError: greenlet is being finalized Jun 19 04:11:20 devstack cinder-volume[93188]: Exception ignored in: Jun 19 04:11:20 devstack cinder-volume[93188]: Traceback (most recent call last): Jun 19 04:11:20 devstack cinder-volume[93188]: File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/common.py", line 467, in __del__ Jun 19 04:11:20 devstack cinder-volume[93188]: File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/common.py", line 457, in _done Jun 19 04:11:20 devstack cinder-volume[93188]: File "/usr/lib/python3.12/logging/__init__.py", line 1526, in debug Jun 19 04:11:20 devstack cinder-volume[93188]: File "/usr/lib/python3.12/logging/__init__.py", line 1800, in isEnabledFor Jun 19 04:11:20 devstack cinder-volume[93188]: File "/usr/lib/python3.12/logging/__init__.py", line 241, in _acquireLock Jun 19 04:11:20 devstack cinder-volume[93188]: File "/usr/lib/python3.12/threading.py", line 198, in acquire Jun 19 04:11:20 devstack cinder-volume[93188]: File "/opt/stack/data/venv/lib/python3.12/site-packages/eventlet/green/thread.py", line 39, in get_ident Jun 19 04:11:20 devstack cinder-volume[93188]: RuntimeError: greenlet is being finalized Jun 19 04:11:20 devstack cinder-volume[93528]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jun 19 04:11:20 devstack cinder-volume[93528]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:11:20 devstack cinder-volume[93528]: we strongly recommend against using it for new projects. Jun 19 04:11:20 devstack cinder-volume[93528]: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:11:20 devstack cinder-volume[93528]: framework. For more detail see Jun 19 04:11:20 devstack cinder-volume[93528]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:11:20 devstack cinder-volume[93528]: import eventlet # noqa Jun 19 04:11:23 devstack cinder-volume[93528]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=93528) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 19 04:11:23 devstack cinder-volume[93528]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=93528) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 19 04:11:23 devstack cinder-volume[93528]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=93528) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 19 04:11:24 devstack cinder-volume[93528]: INFO dbcounter [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Registered counter for database cinder Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_db.sqlalchemy.engines [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93528) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG dbcounter [-] [93528] Writer thread running {{(pid=93528) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:11:24 devstack cinder-volume[93528]: INFO cinder.rpc [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jun 19 04:11:24 devstack cinder-volume[93528]: INFO cinder.rpc [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_db.sqlalchemy.engines [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93528) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:24 devstack cinder-volume[93528]: INFO cinder.volume.manager [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Determined volume DB was empty at startup. Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG cinder.volume.manager [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=93528) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jun 19 04:11:24 devstack cinder-volume[93528]: WARNING stevedore.named [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jun 19 04:11:24 devstack cinder-volume[93528]: WARNING castellan.key_manager [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:11:24 devstack cinder-volume[93528]: WARNING cinder.keymgr.conf_key_mgr [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jun 19 04:11:24 devstack cinder-volume[93528]: INFO cinder.volume.manager [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_db.sqlalchemy.engines [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93528) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:24 devstack cinder-volume[93528]: INFO oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Starting 1 workers Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Started child 93769 {{(pid=93528) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Full set of CONF: {{(pid=93528) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] ******************************************************************************** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Configuration options gathered from: {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] ================================================================================ {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] allow_availability_zone_fallback = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] allow_compression_on_image_upload = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] allowed_direct_url_schemes = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] api_rate_limit = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] auth_strategy = keystone {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_availability_zone = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_host = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_stats_polling_interval = 60 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backup_api_class = cinder.backup.api.API {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93769]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backup_name_template = backup-%s {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backup_use_same_host = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backup_use_temp_snapshot = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] chap_password = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] chap_username = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cinder_internal_tenant_project_id = 5333a7a502f849018d89a80963a6a528 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cinder_internal_tenant_user_id = 877275992df44446bd578786473ba9bc {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cluster = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] compression_format = gzip {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] compute_api_class = cinder.compute.nova.API {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] config_dir = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] config_source = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] control_exchange = openstack {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] debug = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] default_availability_zone = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] default_group_type = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] default_volume_type = QuobyteHD {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] disk_geometry = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] driver_client_cert = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] driver_client_cert_key = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] driver_data_namespace = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] driver_ssl_cert_path = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] driver_ssl_cert_verify = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] driver_use_ssl = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] enable_new_services = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] enable_unsupported_driver = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] enabled_backends = ['QuobyteHD'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] enforce_multipath_for_image_xfer = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] filter_function = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_api_insecure = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_api_servers = ['http://192.168.122.84/image'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_api_ssl_compression = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_ca_certificates_file = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_catalog_info = image:glance:publicURL {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_certfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_keyfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_num_retries = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance_request_timeout = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] goodness_function = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] graceful_shutdown_timeout = 5 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] group_api_class = cinder.group.api.API {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] host = devstack {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_compress_on_upload = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_conversion_address_space_limit = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_conversion_cpu_limit = 60 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_conversion_disable = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_upload_use_cinder_backend = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_upload_use_internal_tenant = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_volume_cache_enabled = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_volume_cache_max_count = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] image_volume_cache_max_size_gb = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] init_host_max_objects_retrieval = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] instance_format = [instance: %(uuid)s] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] iscsi_target_flags = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] iscsi_write_cache = on {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] iser_helper = tgtadm {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] iser_ip_address = 192.168.122.84 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] iser_port = 3260 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] log_color = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] log_config_append = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] log_dir = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] log_file = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] log_options = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] log_rotate_interval = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] log_rotate_interval_type = days {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] log_rotation_type = none {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] max_age = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] max_logfile_count = 30 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] max_logfile_size_mb = 200 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] max_over_subscription_ratio = 20.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] message_reap_interval = 86400 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] message_ttl = 2592000 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Starting volume driver QuobyteDriver (1.1.14) Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] migration_create_volume_timeout_secs = 300 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=93769) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] monkey_patch = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] monkey_patch_modules = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] my_ip = 192.168.122.84 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] no_snapshot_gb_quota = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] num_iser_scan_tries = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] num_shell_tries = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] num_volume_device_scan_tries = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] nvmeof_conn_info_version = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] nvmet_ns_id = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] nvmet_port_id = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] osapi_max_limit = 1000 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] osapi_volume_ext_list = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] osapi_volume_listen = 0.0.0.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] osapi_volume_listen_port = 8776 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] osapi_volume_use_ssl = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] osapi_volume_workers = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] per_volume_size_limit = -1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] periodic_fuzzy_delay = 60 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] periodic_interval = 60 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] project_id_regex = [0-9a-f\-]+ {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] public_endpoint = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] publish_errors = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] quota_backup_gigabytes = 1000 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] quota_backups = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] quota_gigabytes = 1000 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] quota_groups = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] quota_snapshots = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] quota_volumes = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] rate_limit_burst = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] rate_limit_except_level = CRITICAL {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] rate_limit_interval = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] reinit_driver_count = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] replication_device = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] report_discard_supported = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] report_interval = 120 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] reservation_clean_interval = 86400 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] reservation_expire = 86400 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] reserved_image_namespaces = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] reserved_percentage = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] rpc_response_timeout = 120 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] run_external_periodic_tasks = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] scst_target_driver = iscsi {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] scst_target_iqn_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_down_time = 720 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] shell_completion = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] snapshot_name_template = snapshot-%s {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] split_loggers = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] state_path = /opt/stack/data/cinder {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] storage_availability_zone = nova {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] storage_protocol = iSCSI {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] syslog_log_facility = LOG_USER {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] target_helper = lioadm {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] target_ip_address = 192.168.122.84 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] target_port = 3260 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] target_protocol = iscsi {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] target_secondary_ip_addresses = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] trace_flags = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] transfer_api_class = cinder.transfer.api.API {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] transport_url = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] until_refresh = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] use_chap_auth = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] use_default_quota_class = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] use_journal = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] use_json = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] use_multipath_for_image_xfer = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] use_stderr = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] use_syslog = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] verify_glance_signatures = enabled {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_api_class = cinder.volume.api.API {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_backend_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_clear = zero {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_clear_ionice = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_clear_size = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_copy_bps_limit = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_dd_blocksize = 1M {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_name_template = volume-%s {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_service_inithost_offload = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volume_usage_audit_period = month {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] zoning_mode = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_concurrency.disable_process_locking = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.auth_section = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.auth_type = password {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.auth_version = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.cache = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.certfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.delay_auth_decision = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.http_connect_timeout = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.include_service_catalog = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.insecure = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.interface = public {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.keyfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_password = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcache_username = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.region_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.service_token_roles_required = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.service_type = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.token_cache_time = 300 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.84/identity {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.backend = dogpile.cache.null {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.backend_argument = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.backend_expiration_time = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.config_prefix = cache.oslo {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.debug_cache_backend = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.enable_retry_client = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.enable_socket_keepalive = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.enabled = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.expiration_time = 600 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.hashclient_retry_attempts = 2 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.memcache_dead_retry = 300 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.memcache_pool_maxsize = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.memcache_sasl_enabled = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.password = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.proxies = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.redis_db = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.redis_sentinel_service_name = mymaster {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.redis_server = localhost:6379 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.retry_attempts = 2 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.retry_delay = 0.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=93769) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.socket_keepalive_count = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.socket_keepalive_idle = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.quobyte [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.socket_keepalive_interval = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.socket_timeout = 1.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.quobyte [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.tls_allowed_ciphers = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.tls_cafile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.tls_certfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.tls_enabled = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.tls_keyfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cache.username = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] coordination.backend_url = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Running cmd (subprocess): mount.quobyte {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.asyncio_connection = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.asyncio_slave_connection = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.backend = sqlalchemy {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.connection = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.connection_debug = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.connection_parameters = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.connection_recycle_time = 3600 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.connection_trace = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.db_inc_retry_interval = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.db_max_retries = 20 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.db_max_retry_interval = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.db_retry_interval = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.max_overflow = 50 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.max_pool_size = 5 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.max_retries = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.mysql_wsrep_sync_wait = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.pool_timeout = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.retry_interval = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.slave_connection = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.sqlite_synchronous = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.synchronous_reader = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] database.use_db_reconnect = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.connection_string = messaging:// {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.enabled = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.es_doc_type = notification {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.es_scroll_size = 10000 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.es_scroll_time = 2m {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.filter_error_trace = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.hmac_keys = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.sentinel_service_name = mymaster {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.socket_timeout = 0.1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.trace_requests = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler.trace_sqlalchemy = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler_jaeger.process_tags = {} {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler_jaeger.service_name_prefix = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] profiler_otlp.service_name_prefix = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.enforce_new_defaults = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: WARNING oslo_config.cfg [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.enforce_scope = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.policy_default_rule = default {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.policy_file = policy.yaml {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_policy.remote_timeout = 60.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] privsep_osbrick.group = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] privsep_osbrick.helper_command = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] privsep_osbrick.user = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cinder_sys_admin.group = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cinder_sys_admin.helper_command = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] cinder_sys_admin.user = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.auth_section = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.auth_type = password {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.cafile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.certfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.collect_timing = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.insecure = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.keyfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.send_service_user_token = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.split_loggers = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] service_user.timeout = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.auth_section = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.auth_type = password {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.certfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.collect_timing = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.insecure = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.keyfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.region_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.split_loggers = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] glance.timeout = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.backend_availability_zone = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.chap_password = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.chap_username = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.disk_geometry = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.driver_client_cert = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.driver_client_cert_key = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.driver_data_namespace = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.driver_use_ssl = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.enable_unsupported_driver = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.extra_capabilities = {} {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.filter_function = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.goodness_function = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.iscsi_target_flags = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.iscsi_write_cache = on {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.iser_helper = tgtadm {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.iser_ip_address = 192.168.122.84 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.iser_port = 3260 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_host = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_login = admin {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_mount_options = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_password = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_private_key = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_share_path = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_ssh_port = 22 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.num_shell_tries = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.nvmet_port_id = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.quobyte_client_cfg = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.quobyte_volume_url = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.replication_device = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.report_discard_supported = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.reserved_percentage = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.scst_target_driver = iscsi {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.scst_target_iqn_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.storage_protocol = iSCSI {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.target_helper = tgtadm {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.target_ip_address = 192.168.122.84 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.target_port = 3260 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.target_protocol = iscsi {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.trace_flags = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.unique_fqdn_network = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.use_chap_auth = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.volume_backend_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.volume_clear = zero {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.volume_clear_ionice = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.volume_clear_size = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_reports.file_event_handler = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_reports.log_dir = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.backend_availability_zone = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.backend_host = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.chap_password = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack quobyte-client[93775]: Reading configuration file: /etc/quobyte/client.cfg Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.chap_username = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.chiscsi_conf = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.disk_geometry = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.driver_client_cert = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack quobyte-client[93775]: Invalid parameters found, error: missing mount point. Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.driver_client_cert_key = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.driver_data_namespace = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.driver_use_ssl = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack quobyte-client[93775]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.extra_capabilities = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.filter_function = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack quobyte-client[93775]: Failed to parse all commandline parameters, please use -h/--help to see available options. Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] CMD "mount.quobyte" returned: 1 in 0.068s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.goodness_function = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.iscsi_target_flags = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.iscsi_write_cache = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.iser_helper = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.iser_ip_address = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.iser_port = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.iser_target_prefix = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_host = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_login = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_mount_options = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_password = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_private_key = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_share_path = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_ssh_port = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.num_shell_tries = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nvmet_ns_id = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.nvmet_port_id = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.replication_device = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.report_discard_supported = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.reserved_percentage = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.scst_target_driver = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.storage_protocol = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.target_helper = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.target_ip_address = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.target_port = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.target_prefix = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.target_protocol = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.trace_flags = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.unique_fqdn_network = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.use_chap_auth = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.volume_clear = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.volume_clear_ionice = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.volume_clear_size = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] QuobyteHD.volumes_dir = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.ssl = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.ssl_version = {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack sudo[93776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_notifications.driver = [] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_notifications.retry = -1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] oslo_messaging_notifications.transport_url = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack sudo[93776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] key_manager.fixed_key = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.barbican_api_version = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.barbican_endpoint = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.barbican_endpoint_type = public {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.barbican_region_name = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.cafile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.certfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.collect_timing = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.insecure = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.keyfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.number_of_retries = 60 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.retry_delay = 1 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.send_service_user_token = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.split_loggers = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.timeout = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.verify_ssl = True {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican.verify_ssl_path = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican_service_user.auth_section = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican_service_user.auth_type = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican_service_user.cafile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican_service_user.certfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican_service_user.collect_timing = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican_service_user.insecure = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican_service_user.keyfile = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican_service_user.split_loggers = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] barbican_service_user.timeout = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.approle_role_id = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.approle_secret_id = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.kv_mountpoint = secret {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.kv_path = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.kv_version = 2 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.namespace = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.root_token_id = **** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.ssl_ca_crt_file = None {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.timeout = 60.0 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.use_ssl = False {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jun 19 04:11:24 devstack cinder-volume[93528]: DEBUG oslo_service.backend._eventlet.service [None req-59a1a8a8-7a66-4fe1-af4f-dac137e72b20 None None] ******************************************************************************** {{(pid=93528) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jun 19 04:11:25 devstack sudo[93776]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.611s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:25 devstack cinder-volume[93769]: INFO cinder.volume.driver [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Driver hasn't implemented _init_vendor_properties() Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG cinder.volume.driver [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93769) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG oslo_db.sqlalchemy.engines [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93769) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writer thread running {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG cinder.db.api [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Building query based on filter {{(pid=93769) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=93769) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:25 devstack cinder-volume[93769]: INFO cinder.keymgr.migration [None req-7b1806c8-89b2-4161-b08c-6cd491c6f454 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jun 19 04:11:25 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:11:25 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:26 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.582s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:11:26 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Driver initialization completed successfully. Jun 19 04:11:26 devstack cinder-volume[93769]: INFO cinder.manager [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Initiating service 3 cleanup Jun 19 04:11:26 devstack cinder-volume[93769]: INFO cinder.manager [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Service 3 cleanup completed. Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG cinder.service [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Creating RPC server for service cinder-volume {{(pid=93769) start /opt/stack/cinder/cinder/service.py:231}} Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG cinder.service [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=93769) start /opt/stack/cinder/cinder/service.py:237}} Jun 19 04:11:26 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:11:26 devstack sudo[93815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:11:26 devstack sudo[93815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:11:26 devstack sudo[93815]: pam_unix(sudo:session): session closed for user root Jun 19 04:11:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.596s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:11:26 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e0f36403-76a7-4b0a-8667-75cc7380c3d8 None None] Driver post RPC initialization completed successfully. Jun 19 04:11:34 devstack cinder-volume[93528]: DEBUG dbcounter [-] [93528] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=93528) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:36 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:36 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=2 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:11:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:11:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 6 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:11:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:12:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:12:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:41 devstack sudo[94396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:12:41 devstack sudo[94396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:42 devstack sudo[94396]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.986s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:12:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:12:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 6 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:12:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:12:46 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:12:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Flow 'volume_create_manager' (462aa846-adf0-4e9c-8523-5018a28cac81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:12:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3f590a-d3ac-429e-ba47-96effd8c3c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f3f590a-d3ac-429e-ba47-96effd8c3c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2042707881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ace3b6c-68ff-4407-9494-e9920a1e1f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae9e0a71af546809a23d233e6e99e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:47Z,use_quota=True,user_id='0f7db5b6768446dab1bb14c275136928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f95071d-a7da-4c3b-9998-67bcbb3b7cdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f95071d-a7da-4c3b-9998-67bcbb3b7cdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac3a393-ce0d-4acc-8030-fb904023d2cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cac3a393-ce0d-4acc-8030-fb904023d2cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ace3b6c-68ff-4407-9494-e9920a1e1f33', 'volume_name': 'volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3633bf2-c68a-4bcc-bddd-001e12ca833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3633bf2-c68a-4bcc-bddd-001e12ca833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66d4503-64dc-41e8-b8fd-6b10fc8b5adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:47 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Volume 8ace3b6c-68ff-4407-9494-e9920a1e1f33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33', 'volume_size': 1} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2042707881',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ace3b6c-68ff-4407-9494-e9920a1e1f33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8ae9e0a71af546809a23d233e6e99e55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:47Z,use_quota=True,user_id='0f7db5b6768446dab1bb14c275136928',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Creating volume 8ace3b6c-68ff-4407-9494-e9920a1e1f33 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:12:47 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:12:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:47 devstack sudo[94415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 1073741824 Jun 19 04:12:47 devstack sudo[94415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:48 devstack sudo[94415]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 1073741824" returned: 0 in 1.969s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:49 devstack sudo[94742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 Jun 19 04:12:49 devstack sudo[94742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:50 devstack sudo[94742]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33" returned: 0 in 1.824s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] <== create_volume: return (3959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:12:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.970s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f66d4503-64dc-41e8-b8fd-6b10fc8b5adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c2bede-b6bb-4cb7-a066-c89caa946fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:51 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Volume volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 (8ace3b6c-68ff-4407-9494-e9920a1e1f33): created successfully Jun 19 04:12:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c2bede-b6bb-4cb7-a066-c89caa946fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Flow 'volume_create_manager' (462aa846-adf0-4e9c-8523-5018a28cac81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:12:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-79800ea5-9bf1-4a51-a044-fc719b5476ff tempest-VolumesAdminNegativeTest-317454480 None] Created volume successfully. Jun 19 04:12:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Acquiring lock "cinder-8ace3b6c-68ff-4407-9494-e9920a1e1f33-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:12:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Lock "cinder-8ace3b6c-68ff-4407-9494-e9920a1e1f33-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:12:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Acquiring lock "cinder-quobyte-8ace3b6c-68ff-4407-9494-e9920a1e1f33" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:12:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Lock "cinder-quobyte-8ace3b6c-68ff-4407-9494-e9920a1e1f33" acquired by "delete_volume" :: waited 0.049s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:12:52 devstack cinder-volume[93769]: INFO oslo.privsep.daemon [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpba_caudg/privsep.sock'] Jun 19 04:12:52 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpba_caudg/privsep.sock Jun 19 04:12:52 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:54 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 19 04:12:54 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:12:54 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 19 04:12:54 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:12:54 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:12:54 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 19 04:12:54 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:12:54 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:12:54 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 19 04:12:55 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 19 04:12:55 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 19 04:12:55 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 19 04:12:55 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:12:55 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 19 04:12:55 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 19 04:12:55 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 19 04:12:55 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: Jun 19 04:12:55 devstack cinder-volume[93769]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 19 04:12:56 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:56 devstack cinder-volume[93769]: INFO oslo.privsep.daemon [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Spawned new privsep daemon via rootwrap Jun 19 04:12:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Accepted privsep connection to /tmp/tmpba_caudg/privsep.sock {{(pid=93769) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jun 19 04:12:56 devstack cinder-volume[93769]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 19 04:12:56 devstack cinder-volume[93769]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 19 04:12:56 devstack cinder-volume[93769]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 19 04:12:56 devstack cinder-volume[93769]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 94763 Jun 19 04:12:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac88ef06-bc7a-40af-ab4a-7d63e040f0b4]: (2,) {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:12:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06efc2c-d897-4766-bd6e-7b6c20addc21]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:12:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:56 devstack sudo[94766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 Jun 19 04:12:56 devstack sudo[94766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:58 devstack sudo[94766]: pam_unix(sudo:session): session closed for user root Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33" returned: 0 in 1.952s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:58 devstack sudo[94773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33 Jun 19 04:12:58 devstack sudo[94773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Flow 'volume_create_manager' (94c3c069-8899-47ad-aa05-5f59a04115f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fd5f41-ef22-4a7b-bfe6-e5c6e6688584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17fd5f41-ef22-4a7b-bfe6-e5c6e6688584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1408623414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194a013d-8dd9-421e-9147-7dfb09c042b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86744c2845da4dc8b404eef73beac0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:59Z,use_quota=True,user_id='2cb2daa4fa13453a8bb6a4812c8c60d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1ae229-818b-4bfe-8b38-adb4ac25f8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b1ae229-818b-4bfe-8b38-adb4ac25f8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb39c26-dd0e-4647-b370-99cd64014f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abb39c26-dd0e-4647-b370-99cd64014f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '194a013d-8dd9-421e-9147-7dfb09c042b7', 'volume_name': 'volume-194a013d-8dd9-421e-9147-7dfb09c042b7', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9876ca4a-0eec-44a0-819f-5109f9c0107e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9876ca4a-0eec-44a0-819f-5109f9c0107e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1133fe-5791-4745-83d6-c67628c12c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:12:58 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Volume 194a013d-8dd9-421e-9147-7dfb09c042b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-194a013d-8dd9-421e-9147-7dfb09c042b7', 'volume_size': 1} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1408623414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=194a013d-8dd9-421e-9147-7dfb09c042b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86744c2845da4dc8b404eef73beac0ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:12:59Z,use_quota=True,user_id='2cb2daa4fa13453a8bb6a4812c8c60d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Creating volume 194a013d-8dd9-421e-9147-7dfb09c042b7 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:12:58 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:12:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:12:59 devstack sudo[94775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 1073741824 Jun 19 04:12:59 devstack sudo[94775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:00 devstack sudo[94773]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8ace3b6c-68ff-4407-9494-e9920a1e1f33" returned: 0 in 1.737s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Lock "cinder-quobyte-8ace3b6c-68ff-4407-9494-e9920a1e1f33" released by "delete_volume" :: held 7.795s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:00 devstack cinder-volume[93769]: WARNING cinder.quota [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:13:00 devstack cinder-volume[93769]: WARNING cinder.quota [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:13:00 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Created reservations ['798e7439-457b-468d-8e46-96781e14a130', '6df328d1-4194-4372-a4c6-8d36b3ff9804', '1aff05c9-fb12-4ca5-a5ec-aa0be690464b', '5902269e-7c6f-4d65-b1f1-582872179824'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:13:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:00 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:13:00 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:01 devstack sudo[94775]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 1073741824" returned: 0 in 2.537s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:01 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 Jun 19 04:13:01 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:03 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 2.526s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:13:03 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Deleted volume successfully. Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7a82f5e5-7ac4-45b6-97ef-756acebf7337 tempest-VolumesAdminNegativeTest-317454480 None] Lock "cinder-8ace3b6c-68ff-4407-9494-e9920a1e1f33-delete_volume" released by "delete_volume" :: held 11.024s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:03 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7" returned: 0 in 2.116s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] <== create_volume: return (4779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.782s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce1133fe-5791-4745-83d6-c67628c12c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-194a013d-8dd9-421e-9147-7dfb09c042b7', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb09cfe0-e311-458c-b535-88a29e25ead4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:03 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Volume volume-194a013d-8dd9-421e-9147-7dfb09c042b7 (194a013d-8dd9-421e-9147-7dfb09c042b7): created successfully Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb09cfe0-e311-458c-b535-88a29e25ead4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Flow 'volume_create_manager' (94c3c069-8899-47ad-aa05-5f59a04115f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:03 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-791890a4-2354-4024-8926-2fa9b585c576 tempest-DeleteServersTestJSON-1733520901 None] Created volume successfully. Jun 19 04:13:10 devstack cinder-volume[93769]: WARNING py.warnings [req-aa2c0508-bac7-47cc-99b4-9ee8996cadda req-42c4a90d-f381-47d3-9e3b-2fab7629ffe9 tempest-DeleteServersTestJSON-1733520901 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Jun 19 04:13:10 devstack cinder-volume[93769]: .first() Jun 19 04:13:10 devstack cinder-volume[93769]: Jun 19 04:13:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-aa2c0508-bac7-47cc-99b4-9ee8996cadda req-42c4a90d-f381-47d3-9e3b-2fab7629ffe9 tempest-DeleteServersTestJSON-1733520901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-aa2c0508-bac7-47cc-99b4-9ee8996cadda req-42c4a90d-f381-47d3-9e3b-2fab7629ffe9 tempest-DeleteServersTestJSON-1733520901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:10 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9d2715-eb18-454b-a42b-974a99de75d3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-aa2c0508-bac7-47cc-99b4-9ee8996cadda req-42c4a90d-f381-47d3-9e3b-2fab7629ffe9 tempest-DeleteServersTestJSON-1733520901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:11 devstack sudo[94947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 Jun 19 04:13:11 devstack sudo[94947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:11 devstack sudo[94947]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-aa2c0508-bac7-47cc-99b4-9ee8996cadda req-42c4a90d-f381-47d3-9e3b-2fab7629ffe9 tempest-DeleteServersTestJSON-1733520901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7" returned: 0 in 0.879s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-aa2c0508-bac7-47cc-99b4-9ee8996cadda req-42c4a90d-f381-47d3-9e3b-2fab7629ffe9 tempest-DeleteServersTestJSON-1733520901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.906s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-aa2c0508-bac7-47cc-99b4-9ee8996cadda req-42c4a90d-f381-47d3-9e3b-2fab7629ffe9 tempest-DeleteServersTestJSON-1733520901 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-194a013d-8dd9-421e-9147-7dfb09c042b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '724791ab-7130-4801-9b05-191744956e3a', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:13:12 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-aa2c0508-bac7-47cc-99b4-9ee8996cadda req-42c4a90d-f381-47d3-9e3b-2fab7629ffe9 tempest-DeleteServersTestJSON-1733520901 None] attachment_update completed successfully. Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Flow 'volume_create_manager' (20fc7d6f-d0e2-4d25-ba1a-9514d65f9e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fec917-b611-4086-a6c2-d5a964a5ff95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8fec917-b611-4086-a6c2-d5a964a5ff95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1064857562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bc5f11-4ce4-457d-a820-ea7ba58ea1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fae8746365149e2a0363b0597469494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:20Z,use_quota=True,user_id='f4d46cdc1c324befad3196d86cdade04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ee8d90-765f-4957-97f8-c0fa9bcb35d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ee8d90-765f-4957-97f8-c0fa9bcb35d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ce6a30-f9c7-4140-81e4-3ad65d372fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36ce6a30-f9c7-4140-81e4-3ad65d372fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38bc5f11-4ce4-457d-a820-ea7ba58ea1fb', 'volume_name': 'volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6c4ca5-8fed-4098-9ac6-b13522d7f903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb6c4ca5-8fed-4098-9ac6-b13522d7f903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d04c4f4-0630-4f16-a38e-800f4aada2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:19 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Volume 38bc5f11-4ce4-457d-a820-ea7ba58ea1fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb', 'volume_size': 1} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:13:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1064857562',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38bc5f11-4ce4-457d-a820-ea7ba58ea1fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5fae8746365149e2a0363b0597469494',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:13:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:13:20Z,use_quota=True,user_id='f4d46cdc1c324befad3196d86cdade04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:13:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Creating volume 38bc5f11-4ce4-457d-a820-ea7ba58ea1fb {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:13:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:13:20 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:13:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:20 devstack sudo[95410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb 1073741824 Jun 19 04:13:20 devstack sudo[95410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:21 devstack sudo[95410]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb 1073741824" returned: 0 in 1.212s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:21 devstack sudo[95420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb Jun 19 04:13:21 devstack sudo[95420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-208fde20-36e3-44c3-8a7d-c59cea7cde8a req-1fd6359c-367e-4b29-859e-292d1c7f18e4 tempest-DeleteServersTestJSON-1733520901 None] Terminate volume connection completed successfully. Jun 19 04:13:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-208fde20-36e3-44c3-8a7d-c59cea7cde8a req-1fd6359c-367e-4b29-859e-292d1c7f18e4 tempest-DeleteServersTestJSON-1733520901 None] Deleting attachment 724791ab-7130-4801-9b05-191744956e3a. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:13:22 devstack sudo[95420]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb" returned: 0 in 0.912s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] <== create_volume: return (2193ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:13:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.195s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d04c4f4-0630-4f16-a38e-800f4aada2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302eb6d1-61d3-461b-a953-f20aaa55040f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:13:22 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Volume volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb (38bc5f11-4ce4-457d-a820-ea7ba58ea1fb): created successfully Jun 19 04:13:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (302eb6d1-61d3-461b-a953-f20aaa55040f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:13:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Flow 'volume_create_manager' (20fc7d6f-d0e2-4d25-ba1a-9514d65f9e97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:13:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-96e4aaf3-26f0-4cbe-8e59-34eaf8d70515 tempest-AttachVolumeShelveTestJSON-310855876 None] Created volume successfully. Jun 19 04:13:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Acquiring lock "cinder-194a013d-8dd9-421e-9147-7dfb09c042b7-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Lock "cinder-194a013d-8dd9-421e-9147-7dfb09c042b7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Acquiring lock "cinder-quobyte-194a013d-8dd9-421e-9147-7dfb09c042b7" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:13:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Lock "cinder-quobyte-194a013d-8dd9-421e-9147-7dfb09c042b7" acquired by "delete_volume" :: waited 0.055s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:13:26 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fe6302-eec0-425d-91e5-77ab677c0a7a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:13:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:26 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 Jun 19 04:13:26 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:27 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7" returned: 0 in 1.054s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:27 devstack sudo[95494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7 Jun 19 04:13:27 devstack sudo[95494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:28 devstack sudo[95494]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-194a013d-8dd9-421e-9147-7dfb09c042b7" returned: 0 in 0.686s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Lock "cinder-quobyte-194a013d-8dd9-421e-9147-7dfb09c042b7" released by "delete_volume" :: held 1.860s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:28 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Created reservations ['63c18970-074d-45ef-819c-5cdeb5837b3c', '35ef9508-a687-424a-b034-86c38d4e2b3a', '84d7f2cb-79d9-4573-8326-0b57d1d2d188', 'eb5ded2d-6d91-42c9-944d-74340c7387a9'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:13:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:28 devstack sudo[95497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:13:28 devstack sudo[95497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:29 devstack sudo[95497]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.919s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:29 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:13:29 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Deleted volume successfully. Jun 19 04:13:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c31ba909-88ee-44b5-9f18-61f97efb40fd tempest-DeleteServersTestJSON-1733520901 None] Lock "cinder-194a013d-8dd9-421e-9147-7dfb09c042b7-delete_volume" released by "delete_volume" :: held 3.212s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:13:38 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=24,cinder:UPDATE=24,cinder:INSERT=8,cinder:DELETE=2 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:39 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=30,cinder:SELECT=22,cinder:INSERT=3,cinder:DELETE=3 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:13:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:13:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:13:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:13:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:13:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:13:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:13:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:13:41 devstack sudo[95656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:13:41 devstack sudo[95656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:13:42 devstack sudo[95656]: pam_unix(sudo:session): session closed for user root Jun 19 04:13:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.750s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:13:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:13:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-2b2fb951-2449-4a73-87ca-1fce00e409a8 req-caa7eeeb-3411-4324-9a33-06a056d8e102 tempest-AttachVolumeShelveTestJSON-310855876 None] No connector for attachment 37931e9e-03f3-4bb1-a497-1fbf1b539331; skipping storage backend terminate_connection call. {{(pid=93769) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jun 19 04:13:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-2b2fb951-2449-4a73-87ca-1fce00e409a8 req-caa7eeeb-3411-4324-9a33-06a056d8e102 tempest-AttachVolumeShelveTestJSON-310855876 None] Deleting attachment 37931e9e-03f3-4bb1-a497-1fbf1b539331. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:13:58 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=2 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Flow 'volume_create_manager' (e423e1fb-3497-4502-953b-df31fa72f489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53091bc7-a4b8-4c81-bc9a-23fcf80403cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53091bc7-a4b8-4c81-bc9a-23fcf80403cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-165484430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f4acdb8e844a76a700ca1e85f65417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:03Z,use_quota=True,user_id='30210ce3bb934ab08f9bdd73865aa318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a347d2a5-dfa7-4d24-a3c0-f70779ef3b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a347d2a5-dfa7-4d24-a3c0-f70779ef3b90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcc5675-37a4-4c23-9bbe-f651f73444bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bcc5675-37a4-4c23-9bbe-f651f73444bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1', 'volume_name': 'volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5a47e0-b5e5-497d-927b-ca19b31b830e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af5a47e0-b5e5-497d-927b-ca19b31b830e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a27e4c-9e30-4878-97b9-7789aedc028e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:03 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Volume ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1', 'volume_size': 1} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-165484430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55f4acdb8e844a76a700ca1e85f65417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:03Z,use_quota=True,user_id='30210ce3bb934ab08f9bdd73865aa318',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Creating volume ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:14:03 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:14:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:03 devstack sudo[95732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 1073741824 Jun 19 04:14:03 devstack sudo[95732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:04 devstack sudo[95732]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 1073741824" returned: 0 in 1.300s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:04 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 Jun 19 04:14:04 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:06 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1" returned: 0 in 1.391s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] <== create_volume: return (2801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:14:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.805s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6a27e4c-9e30-4878-97b9-7789aedc028e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcab04d2-aa55-404b-95b3-bd21bdaa2c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:06 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Volume volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 (ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1): created successfully Jun 19 04:14:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcab04d2-aa55-404b-95b3-bd21bdaa2c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Flow 'volume_create_manager' (e423e1fb-3497-4502-953b-df31fa72f489) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:06 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3820badc-3185-4a90-929b-170475ce38ff tempest-TaggedAttachmentsTest-1672293300 None] Created volume successfully. Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Flow 'volume_create_manager' (48a1c8cc-d8b9-4d79-b2e0-2056bded05a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb41cb07-9d1c-46db-97a4-bb6f50c35584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fb41cb07-9d1c-46db-97a4-bb6f50c35584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1533120332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dc96d0-8d8b-4be9-941f-3c877cbdcab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334398971ded4c8fb14a788d8cd022e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:09Z,use_quota=True,user_id='f9b5cbc73af443f8843dbdd40957235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9aab14-ae4b-4679-96ba-1c0a4482dc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc9aab14-ae4b-4679-96ba-1c0a4482dc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d36b61-3f23-43aa-9992-a3683229af33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5d36b61-3f23-43aa-9992-a3683229af33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49dc96d0-8d8b-4be9-941f-3c877cbdcab5', 'volume_name': 'volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a8c58d-df6a-4a16-91b7-fe0f6c903f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58a8c58d-df6a-4a16-91b7-fe0f6c903f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0db00c-23cc-41f9-8214-9dc9b996ad11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:08 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Volume 49dc96d0-8d8b-4be9-941f-3c877cbdcab5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5', 'volume_size': 1} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1533120332',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49dc96d0-8d8b-4be9-941f-3c877cbdcab5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334398971ded4c8fb14a788d8cd022e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:09Z,use_quota=True,user_id='f9b5cbc73af443f8843dbdd40957235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Creating volume 49dc96d0-8d8b-4be9-941f-3c877cbdcab5 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:14:08 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:14:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:08 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 1073741824 Jun 19 04:14:08 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:09 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 1073741824" returned: 0 in 1.220s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:10 devstack sudo[95850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 Jun 19 04:14:10 devstack sudo[95850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:10 devstack sudo[95850]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5" returned: 0 in 0.854s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] <== create_volume: return (2133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:14:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.136s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a0db00c-23cc-41f9-8214-9dc9b996ad11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69049b52-ef68-427e-8196-df7d9040ae7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:10 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Volume volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 (49dc96d0-8d8b-4be9-941f-3c877cbdcab5): created successfully Jun 19 04:14:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69049b52-ef68-427e-8196-df7d9040ae7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Flow 'volume_create_manager' (48a1c8cc-d8b9-4d79-b2e0-2056bded05a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:10 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1e90953a-fbdc-4b53-b505-90ead36c19a8 tempest-AttachVolumeTestJSON-2068967469 None] Created volume successfully. Jun 19 04:14:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-0311d4e9-6b8f-416a-bc86-8c6e517c701e req-a19a58a5-d5b6-456f-b8d1-2c51463be6bb tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-0311d4e9-6b8f-416a-bc86-8c6e517c701e req-a19a58a5-d5b6-456f-b8d1-2c51463be6bb tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:15 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6dda94-9e6d-4a5e-9913-1feff0e1cf3a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:14:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-0311d4e9-6b8f-416a-bc86-8c6e517c701e req-a19a58a5-d5b6-456f-b8d1-2c51463be6bb tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:15 devstack sudo[96004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 Jun 19 04:14:15 devstack sudo[96004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:16 devstack sudo[96004]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-0311d4e9-6b8f-416a-bc86-8c6e517c701e req-a19a58a5-d5b6-456f-b8d1-2c51463be6bb tempest-AttachVolumeTestJSON-2068967469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5" returned: 0 in 1.174s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-0311d4e9-6b8f-416a-bc86-8c6e517c701e req-a19a58a5-d5b6-456f-b8d1-2c51463be6bb tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.200s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-0311d4e9-6b8f-416a-bc86-8c6e517c701e req-a19a58a5-d5b6-456f-b8d1-2c51463be6bb tempest-AttachVolumeTestJSON-2068967469 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '090d6602-a343-4789-8a2d-be565257f837', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:14:16 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-0311d4e9-6b8f-416a-bc86-8c6e517c701e req-a19a58a5-d5b6-456f-b8d1-2c51463be6bb tempest-AttachVolumeTestJSON-2068967469 None] attachment_update completed successfully. Jun 19 04:14:26 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=8,cinder:SELECT=10,cinder:INSERT=1,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:26 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Flow 'volume_create_manager' (b1491727-8e1c-42d8-909a-71a895835998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13468118-f924-467f-9bb8-18c0f3dd5255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13468118-f924-467f-9bb8-18c0f3dd5255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1718172484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cd5dc8-c047-4b59-81b3-d57f968ec3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1e3c66bd0e41d997189aada0335cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:41Z,use_quota=True,user_id='f0d33b62127a44e59d7d8f0f9fcda9fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8832ec-5598-4bc0-acde-f603c5b80df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df8832ec-5598-4bc0-acde-f603c5b80df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1515b75-172b-40ee-b28b-f8d868b439c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1515b75-172b-40ee-b28b-f8d868b439c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72cd5dc8-c047-4b59-81b3-d57f968ec3d4', 'volume_name': 'volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37fc285-3c9d-46db-a2ba-bd0059ddf502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37fc285-3c9d-46db-a2ba-bd0059ddf502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d3f3da-7813-43bb-9c0a-b0e38091712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:40 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Volume 72cd5dc8-c047-4b59-81b3-d57f968ec3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4', 'volume_size': 1} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:14:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1718172484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72cd5dc8-c047-4b59-81b3-d57f968ec3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c1e3c66bd0e41d997189aada0335cd8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:14:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:14:41Z,use_quota=True,user_id='f0d33b62127a44e59d7d8f0f9fcda9fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Creating volume 72cd5dc8-c047-4b59-81b3-d57f968ec3d4 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:14:40 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:14:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:40 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 1073741824 Jun 19 04:14:40 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:14:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:14:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:14:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:14:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:14:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:41 devstack sudo[97484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:14:41 devstack sudo[97484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:43 devstack sudo[97484]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.651s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:43 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:14:43 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:14:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 8 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:14:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:14:43 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 1073741824" returned: 0 in 2.738s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:14:43 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 Jun 19 04:14:43 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:14:44 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Jun 19 04:14:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4" returned: 0 in 1.026s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:14:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] <== create_volume: return (3843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:14:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.845s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:14:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d3f3da-7813-43bb-9c0a-b0e38091712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9c647b-b94a-4703-984c-9817ed314abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:14:44 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Volume volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 (72cd5dc8-c047-4b59-81b3-d57f968ec3d4): created successfully Jun 19 04:14:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e9c647b-b94a-4703-984c-9817ed314abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:14:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Flow 'volume_create_manager' (b1491727-8e1c-42d8-909a-71a895835998) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:14:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9b638ad6-6a98-49af-bccd-acdc7d56dd81 tempest-ServerRescueNegativeTestJSON-1641508357 None] Created volume successfully. Jun 19 04:14:54 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:14:54 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Acquiring lock "cinder-72cd5dc8-c047-4b59-81b3-d57f968ec3d4-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "cinder-72cd5dc8-c047-4b59-81b3-d57f968ec3d4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Acquiring lock "cinder-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "cinder-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Acquiring lock "cinder-quobyte-72cd5dc8-c047-4b59-81b3-d57f968ec3d4" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "cinder-quobyte-72cd5dc8-c047-4b59-81b3-d57f968ec3d4" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a3948c-93f5-4bfe-8f7a-1e838a188eec]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Acquiring lock "cinder-quobyte-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "cinder-quobyte-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b7b4eb-4622-4a9b-ac2b-a01edfdf67e3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:07 devstack sudo[97929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 Jun 19 04:15:07 devstack sudo[97929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:07 devstack sudo[97930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb Jun 19 04:15:07 devstack sudo[97930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:08 devstack sudo[97930]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb" returned: 0 in 0.762s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:08 devstack sudo[97929]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4" returned: 0 in 0.832s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:08 devstack sudo[97939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb Jun 19 04:15:08 devstack sudo[97939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:08 devstack sudo[97940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4 Jun 19 04:15:08 devstack sudo[97940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:08 devstack sudo[97940]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-72cd5dc8-c047-4b59-81b3-d57f968ec3d4" returned: 0 in 0.623s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "cinder-quobyte-72cd5dc8-c047-4b59-81b3-d57f968ec3d4" released by "delete_volume" :: held 1.507s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Created reservations ['2a474688-0571-43d0-b8ae-52dbd0b35fe4', '70eed366-36fa-4635-835d-138e76fcbd1f', '0f592ee8-bb0d-4dc4-ad74-3d49bb2685eb', 'fdfa512c-03d9-4f26-9605-bf3910318fdb'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:08 devstack sudo[97939]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb" returned: 0 in 0.770s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:08 devstack sudo[97945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:15:08 devstack sudo[97945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:08 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "cinder-quobyte-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb" released by "delete_volume" :: held 1.582s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:09 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Created reservations ['c5ac1b6e-e32d-49a1-94d5-d209ca517df2', '7c7cf18c-2797-4d64-a38e-71c914df70c3', 'fc9d797a-04ec-4bac-97a1-10a985759a65', '7f62f992-b0c8-4e12-b923-5b5c0da05958'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:09 devstack sudo[97947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:15:09 devstack sudo[97947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:10 devstack sudo[97945]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.149s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:10 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:10 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Deleted volume successfully. Jun 19 04:15:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bbf8d11c-57f6-4a18-a65b-b9535cd61b9a tempest-ServerRescueNegativeTestJSON-1641508357 None] Lock "cinder-72cd5dc8-c047-4b59-81b3-d57f968ec3d4-delete_volume" released by "delete_volume" :: held 3.021s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:10 devstack sudo[97947]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.173s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:10 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:10 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Deleted volume successfully. Jun 19 04:15:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-288d3a2f-7575-4f7b-8203-e69aa2c5acc4 tempest-AttachVolumeShelveTestJSON-310855876 None] Lock "cinder-38bc5f11-4ce4-457d-a820-ea7ba58ea1fb-delete_volume" released by "delete_volume" :: held 3.123s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:15:20 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:15:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b487684a-13f4-49d1-8d3f-f191e3c7443f tempest-BackendsCapabilitiesAdminTestsJSON-1665084966 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93769) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 19 04:15:20 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=22,cinder:SELECT=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:15:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab7706c1-c01e-436b-9b4d-4ec72086e977 tempest-BackendsCapabilitiesAdminTestsJSON-1665084966 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7578201293945, 'free_capacity_gb': 1775.7578201293945, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=93769) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jun 19 04:15:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-27b8335b-8848-4038-b1b5-3baf71c37410 req-4c19e5d1-0108-4d3f-8c1a-7ba26a53e881 tempest-AttachVolumeTestJSON-2068967469 None] Terminate volume connection completed successfully. Jun 19 04:15:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-27b8335b-8848-4038-b1b5-3baf71c37410 req-4c19e5d1-0108-4d3f-8c1a-7ba26a53e881 tempest-AttachVolumeTestJSON-2068967469 None] Deleting attachment 090d6602-a343-4789-8a2d-be565257f837. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:15:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-1ff3ca84-7662-4b1a-914b-5425af08d8db req-2675de5c-04c9-44c5-a107-2e0a40f805a0 tempest-TaggedAttachmentsTest-1672293300 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-1ff3ca84-7662-4b1a-914b-5425af08d8db req-2675de5c-04c9-44c5-a107-2e0a40f805a0 tempest-TaggedAttachmentsTest-1672293300 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b557848-fb21-4524-80f5-9d33294c2d4f]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:15:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-1ff3ca84-7662-4b1a-914b-5425af08d8db req-2675de5c-04c9-44c5-a107-2e0a40f805a0 tempest-TaggedAttachmentsTest-1672293300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:32 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 Jun 19 04:15:32 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:33 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-1ff3ca84-7662-4b1a-914b-5425af08d8db req-2675de5c-04c9-44c5-a107-2e0a40f805a0 tempest-TaggedAttachmentsTest-1672293300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1" returned: 0 in 1.024s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-1ff3ca84-7662-4b1a-914b-5425af08d8db req-2675de5c-04c9-44c5-a107-2e0a40f805a0 tempest-TaggedAttachmentsTest-1672293300 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.065s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-1ff3ca84-7662-4b1a-914b-5425af08d8db req-2675de5c-04c9-44c5-a107-2e0a40f805a0 tempest-TaggedAttachmentsTest-1672293300 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5bc04da7-c580-4aba-86a8-965dee03d7ef', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:15:33 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-1ff3ca84-7662-4b1a-914b-5425af08d8db req-2675de5c-04c9-44c5-a107-2e0a40f805a0 tempest-TaggedAttachmentsTest-1672293300 None] attachment_update completed successfully. Jun 19 04:15:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f4d288a7-bba7-45f3-b97d-1ffc8619ff94 tempest-GroupsV320Test-45946346 None] Group tempest-GroupsV320Test-Group-1285482110: creating Jun 19 04:15:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-4eb41410-2a9d-4234-94bd-0c6812aa4c89 req-384b3879-ba8d-4642-835d-f0d96ccc454f tempest-TaggedAttachmentsTest-1672293300 None] Terminate volume connection completed successfully. Jun 19 04:15:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-4eb41410-2a9d-4234-94bd-0c6812aa4c89 req-384b3879-ba8d-4642-835d-f0d96ccc454f tempest-TaggedAttachmentsTest-1672293300 None] Deleting attachment 5bc04da7-c580-4aba-86a8-965dee03d7ef. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:15:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f4d288a7-bba7-45f3-b97d-1ffc8619ff94 tempest-GroupsV320Test-45946346 None] Group tempest-GroupsV320Test-Group-1285482110: created successfully Jun 19 04:15:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f4d288a7-bba7-45f3-b97d-1ffc8619ff94 tempest-GroupsV320Test-45946346 None] Create group completed successfully. Jun 19 04:15:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:15:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:41 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:15:41 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:43 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.331s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 8 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] Created reservations ['b84f969f-5aa9-4b4f-ac62-209f0dc0bda9'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:15:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:15:43 devstack sudo[98803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:15:43 devstack sudo[98803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:15:44 devstack sudo[98803]: pam_unix(sudo:session): session closed for user root Jun 19 04:15:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.985s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:15:44 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:15:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b4555345-f0b7-457c-b088-27c5b0489be5 tempest-GroupsV320Test-45946346 None] Delete group completed successfully. Jun 19 04:15:53 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=14,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:15:53 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:16:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Acquiring lock "cinder-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Lock "cinder-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Acquiring lock "cinder-quobyte-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Lock "cinder-quobyte-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1" acquired by "delete_volume" :: waited 0.033s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:02 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fc045a-8d03-4f74-8c66-3aeca2ca7a46]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:02 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 Jun 19 04:16:02 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:04 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1" returned: 0 in 1.593s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:04 devstack sudo[99008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1 Jun 19 04:16:04 devstack sudo[99008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1" returned: 0 in 1.414s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:05 devstack sudo[99008]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:05 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Lock "cinder-quobyte-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1" released by "delete_volume" :: held 3.094s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:05 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Created reservations ['ded28d61-a2a5-4ee5-8480-c83d8f00f70c', '060de108-63fd-44c0-9a6a-ba4283ed5e0c', '73332b9b-1d99-41f5-a8c1-ff730ade92ef', '405c7085-0320-42c9-a5d1-12b660e85b91'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:06 devstack sudo[99050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:16:06 devstack sudo[99050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:07 devstack sudo[99050]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.312s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:07 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:07 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Deleted volume successfully. Jun 19 04:16:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6185af1-dd95-48c5-9340-68052c4acf97 tempest-TaggedAttachmentsTest-1672293300 None] Lock "cinder-ebf80162-cc7d-4231-87f3-a9d3c4ecd6a1-delete_volume" released by "delete_volume" :: held 4.821s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:15 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=8 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:16:17 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=3,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:16:20 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:16:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Flow 'volume_create_manager' (d5d6fe83-df33-451c-b50e-9a2ec37ca630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfb4f6e-2537-4f97-984f-cf3365ca54c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cfb4f6e-2537-4f97-984f-cf3365ca54c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-491600819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a34d3a8-75b9-4836-bdff-209162e0d0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9542a216d41c42b68767af89996113ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:21Z,use_quota=True,user_id='50363822be0141bab3050ae5b941d6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1201f7-54e4-4f6c-9738-f2ba94c18f29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b1201f7-54e4-4f6c-9738-f2ba94c18f29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a413873c-3db0-4e05-9217-db362f265138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a413873c-3db0-4e05-9217-db362f265138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a34d3a8-75b9-4836-bdff-209162e0d0a4', 'volume_name': 'volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91238541-56e4-4373-88e5-e75b0f0cf9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91238541-56e4-4373-88e5-e75b0f0cf9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a673738c-0292-4b98-9ac9-4f672adcb5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:21 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Volume 2a34d3a8-75b9-4836-bdff-209162e0d0a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4', 'volume_size': 1} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-491600819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a34d3a8-75b9-4836-bdff-209162e0d0a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9542a216d41c42b68767af89996113ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:21Z,use_quota=True,user_id='50363822be0141bab3050ae5b941d6f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Creating volume 2a34d3a8-75b9-4836-bdff-209162e0d0a4 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:16:21 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:16:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:21 devstack sudo[99154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 1073741824 Jun 19 04:16:21 devstack sudo[99154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:22 devstack sudo[99154]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 1073741824" returned: 0 in 1.062s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:22 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 Jun 19 04:16:22 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:22 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4" returned: 0 in 0.756s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:16:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a673738c-0292-4b98-9ac9-4f672adcb5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f55b0a-de5c-4fe0-8810-afaed37aa7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:23 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Volume volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 (2a34d3a8-75b9-4836-bdff-209162e0d0a4): created successfully Jun 19 04:16:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03f55b0a-de5c-4fe0-8810-afaed37aa7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Flow 'volume_create_manager' (d5d6fe83-df33-451c-b50e-9a2ec37ca630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:23 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ae6b74d3-200c-495a-a75a-aeb7762da6c1 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Created volume successfully. Jun 19 04:16:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Creating offline snapshot 85b89479-ebb6-402f-b783-7e72c788f282 of volume 2a34d3a8-75b9-4836-bdff-209162e0d0a4 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:16:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd67a10d-f585-4f03-b17d-4d0ed6bc8412]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:24 devstack sudo[99183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 Jun 19 04:16:24 devstack sudo[99183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:26 devstack sudo[99183]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4" returned: 0 in 1.729s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:26 devstack sudo[99243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 1G Jun 19 04:16:26 devstack sudo[99243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:27 devstack sudo[99243]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 1G" returned: 0 in 1.503s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:27 devstack sudo[99256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 Jun 19 04:16:27 devstack sudo[99256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:28 devstack sudo[99256]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282" returned: 0 in 1.007s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:28 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 is being set with open permissions: ugo+rw Jun 19 04:16:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:28 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 Jun 19 04:16:28 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:29 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282" returned: 0 in 1.170s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:30 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.info Jun 19 04:16:30 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:31 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.info" returned: 0 in 1.441s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:31 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.info is being set with open permissions: ugo+rw Jun 19 04:16:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:31 devstack sudo[99271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.info Jun 19 04:16:31 devstack sudo[99271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:32 devstack sudo[99271]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.info" returned: 0 in 1.410s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.467s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:33 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e1d38474-12f3-488f-994c-5baa4adbc9a9 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Create snapshot completed successfully Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Acquiring lock "cinder-85b89479-ebb6-402f-b783-7e72c788f282-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-85b89479-ebb6-402f-b783-7e72c788f282-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Acquiring lock "cinder-quobyte-2a34d3a8-75b9-4836-bdff-209162e0d0a4" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-quobyte-2a34d3a8-75b9-4836-bdff-209162e0d0a4" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Acquiring lock "cinder-quobyte-85b89479-ebb6-402f-b783-7e72c788f282" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-quobyte-85b89479-ebb6-402f-b783-7e72c788f282" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Deleting offline snapshot 85b89479-ebb6-402f-b783-7e72c788f282 of volume 2a34d3a8-75b9-4836-bdff-209162e0d0a4 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] snapshot_file for this snap is: volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e116115-a6de-4cb4-a7b6-057cce16e780]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:35 devstack sudo[99333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 Jun 19 04:16:35 devstack sudo[99333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:35 devstack sudo[99333]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282" returned: 0 in 1.033s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:16:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8ea8e7-fa52-44fa-afd2-4dfacc7d73ea]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:36 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 Jun 19 04:16:36 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:36 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4" returned: 0 in 0.938s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:36 devstack sudo[99346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 Jun 19 04:16:36 devstack sudo[99346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:37 devstack sudo[99346]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282" returned: 0 in 0.877s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:37 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282 Jun 19 04:16:37 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:38 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4.85b89479-ebb6-402f-b783-7e72c788f282" returned: 0 in 0.719s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-quobyte-85b89479-ebb6-402f-b783-7e72c788f282" released by "_delete_snapshot" :: held 3.713s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-quobyte-2a34d3a8-75b9-4836-bdff-209162e0d0a4" released by "delete_snapshot" :: held 3.744s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:38 devstack cinder-volume[93769]: WARNING cinder.quota [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:16:38 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Created reservations ['aac6301b-f0fb-4c69-800e-1314d9ea9207', 'ec2791ab-2523-437c-92fb-b74e1e9db724', 'f63e96e7-facf-4ce7-b15f-e05d48518554', 'c0bd1b6a-b961-45bb-b968-913aa9caf5a0'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Delete snapshot completed successfully. Jun 19 04:16:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-208c1db1-d4db-45a0-9310-a410676972f8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-85b89479-ebb6-402f-b783-7e72c788f282-delete_snapshot" released by "delete_snapshot" :: held 3.904s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Acquiring lock "cinder-2a34d3a8-75b9-4836-bdff-209162e0d0a4-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-2a34d3a8-75b9-4836-bdff-209162e0d0a4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Acquiring lock "cinder-quobyte-2a34d3a8-75b9-4836-bdff-209162e0d0a4" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-quobyte-2a34d3a8-75b9-4836-bdff-209162e0d0a4" acquired by "delete_volume" :: waited 0.032s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:39 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a96e6e2-f6d8-406c-83a3-c3e750a3588d]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:39 devstack sudo[99359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 Jun 19 04:16:39 devstack sudo[99359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:40 devstack sudo[99359]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4" returned: 0 in 0.890s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:40 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4 Jun 19 04:16:40 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Flow 'volume_create_manager' (7805bb4a-3ef6-4142-b7a7-2e3033829d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64d2334-113b-4f0f-8836-2376ae5ca34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64d2334-113b-4f0f-8836-2376ae5ca34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-766950105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443a041a14094cc59b5b1b8d6e9d6215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:40Z,use_quota=True,user_id='bc11128bb204416692aecbe0409aa957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bcbbed-2dcb-4811-85f5-952fbacd63e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (99bcbbed-2dcb-4811-85f5-952fbacd63e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8cb319-f9e3-4127-964a-6053fa4e8564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e8cb319-f9e3-4127-964a-6053fa4e8564) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d', 'volume_name': 'volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4b39f0-6fe5-48ed-a3fe-8ab3cd4e46dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4b39f0-6fe5-48ed-a3fe-8ab3cd4e46dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd3d5c7-31e7-461c-8488-73528dc3f6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:40 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Volume 4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d', 'volume_size': 1} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-766950105',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443a041a14094cc59b5b1b8d6e9d6215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:40Z,use_quota=True,user_id='bc11128bb204416692aecbe0409aa957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Creating volume 4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:16:40 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:16:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:40 devstack sudo[99367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d 1073741824 Jun 19 04:16:40 devstack sudo[99367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:41 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a34d3a8-75b9-4836-bdff-209162e0d0a4" returned: 0 in 0.844s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-quobyte-2a34d3a8-75b9-4836-bdff-209162e0d0a4" released by "delete_volume" :: held 1.834s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Created reservations ['66383414-0cb7-453a-a8b1-11c78c68f93f', '3c6574dd-e53e-4d4c-9351-ecb248faf425', '9dbabf5c-6d14-43e9-902d-dd98939efc2c', '023a08de-9791-48bf-89ca-9f9208573367'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:41 devstack sudo[99386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:16:41 devstack sudo[99386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:41 devstack sudo[99367]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d 1073741824" returned: 0 in 1.041s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:41 devstack sudo[99408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d Jun 19 04:16:41 devstack sudo[99408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:41 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:16:41 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:42 devstack sudo[99386]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.043s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:42 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Deleted volume successfully. Jun 19 04:16:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28783d2e-39ed-483c-abc0-a51fb1ae8b1f tempest-VolumeSnapshotQuotasNegativeTestJSON-1446522611 None] Lock "cinder-2a34d3a8-75b9-4836-bdff-209162e0d0a4-delete_volume" released by "delete_volume" :: held 3.215s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:43 devstack sudo[99408]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d" returned: 0 in 1.478s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] <== create_volume: return (2670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.672s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd3d5c7-31e7-461c-8488-73528dc3f6d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c42a8f-39fb-4b17-a728-0a25b1783c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:43 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Volume volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d (4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d): created successfully Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3c42a8f-39fb-4b17-a728-0a25b1783c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Flow 'volume_create_manager' (7805bb4a-3ef6-4142-b7a7-2e3033829d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:43 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1a7dbf04-f27b-47f6-a954-bc5299592992 tempest-ServersNegativeTestJSON-1955046281 None] Created volume successfully. Jun 19 04:16:43 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.409s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 8 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:16:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Flow 'volume_create_manager' (d12c2e9f-e493-42f4-af82-c8b79abec982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ccc754-a597-4fb8-8d29-4370c1941ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69ccc754-a597-4fb8-8d29-4370c1941ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1254224518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c110c545-859b-4638-8851-cce6f0260633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443a041a14094cc59b5b1b8d6e9d6215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:46Z,use_quota=True,user_id='bc11128bb204416692aecbe0409aa957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e899e3-31c9-4857-a295-ed80469982d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27e899e3-31c9-4857-a295-ed80469982d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3169e42-408d-4a12-853f-151914495299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3169e42-408d-4a12-853f-151914495299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c110c545-859b-4638-8851-cce6f0260633', 'volume_name': 'volume-c110c545-859b-4638-8851-cce6f0260633', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c671e6e-2e80-4600-828e-b23a8a60f239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c671e6e-2e80-4600-828e-b23a8a60f239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487c060-ff28-44cb-a5d6-8f22d1da45d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:46 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Volume c110c545-859b-4638-8851-cce6f0260633: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c110c545-859b-4638-8851-cce6f0260633', 'volume_size': 1} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:16:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1254224518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c110c545-859b-4638-8851-cce6f0260633,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='443a041a14094cc59b5b1b8d6e9d6215',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:16:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:16:46Z,use_quota=True,user_id='bc11128bb204416692aecbe0409aa957',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Creating volume c110c545-859b-4638-8851-cce6f0260633 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:16:46 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:16:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:46 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633 1073741824 Jun 19 04:16:46 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:47 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633 1073741824" returned: 0 in 1.243s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:47 devstack sudo[99481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633 Jun 19 04:16:47 devstack sudo[99481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:48 devstack sudo[99481]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633" returned: 0 in 1.153s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] <== create_volume: return (2443ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:16:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.449s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d487c060-ff28-44cb-a5d6-8f22d1da45d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c110c545-859b-4638-8851-cce6f0260633', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5e20f4-74b1-4efa-b688-c317c3c970e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:16:48 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Volume volume-c110c545-859b-4638-8851-cce6f0260633 (c110c545-859b-4638-8851-cce6f0260633): created successfully Jun 19 04:16:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd5e20f4-74b1-4efa-b688-c317c3c970e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:16:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Flow 'volume_create_manager' (d12c2e9f-e493-42f4-af82-c8b79abec982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:16:48 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5f71de27-b0c1-425f-b18d-a8d53915e522 tempest-ServersNegativeTestJSON-1955046281 None] Created volume successfully. Jun 19 04:16:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "cinder-c110c545-859b-4638-8851-cce6f0260633-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Lock "cinder-c110c545-859b-4638-8851-cce6f0260633-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "cinder-quobyte-c110c545-859b-4638-8851-cce6f0260633" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Lock "cinder-quobyte-c110c545-859b-4638-8851-cce6f0260633" acquired by "delete_volume" :: waited 0.050s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:51 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[655d5886-53b2-4b01-b427-a7617458476a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:51 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633 Jun 19 04:16:51 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:52 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633" returned: 0 in 1.009s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:52 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633 Jun 19 04:16:52 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:53 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c110c545-859b-4638-8851-cce6f0260633" returned: 0 in 1.130s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Lock "cinder-quobyte-c110c545-859b-4638-8851-cce6f0260633" released by "delete_volume" :: held 2.227s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:53 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Created reservations ['10f2d5ce-aff4-4dac-b255-169598f2d32d', '164444e8-092b-4b6c-9192-43952508a10a', 'e49e54ea-0fd8-4e5e-961f-3f6884317302', '884525b5-94a4-4c86-a5e9-16cef1481e4c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:53 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:16:53 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:54 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.767s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:54 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:54 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Deleted volume successfully. Jun 19 04:16:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f4c7a8db-9b10-4f55-b092-9478c34115c8 tempest-ServersNegativeTestJSON-1955046281 None] Lock "cinder-c110c545-859b-4638-8851-cce6f0260633-delete_volume" released by "delete_volume" :: held 3.378s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "cinder-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Lock "cinder-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "cinder-quobyte-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:16:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Lock "cinder-quobyte-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d" acquired by "delete_volume" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:16:54 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb19350d-5317-4f14-ab1c-202c297cefa7]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:16:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:54 devstack sudo[99526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d Jun 19 04:16:54 devstack sudo[99526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:55 devstack sudo[99526]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d" returned: 0 in 1.073s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:55 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d Jun 19 04:16:55 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:56 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d" returned: 0 in 0.758s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Lock "cinder-quobyte-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d" released by "delete_volume" :: held 1.883s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:16:56 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Created reservations ['8f1fbfaf-24fd-4562-a0ac-d92b73ab0d0e', '827ef4fc-9841-4d09-9762-fc900c7c6c97', '0fb7ffe9-8f57-420b-9bc8-ba1549b4e7ac', 'badb2e8d-b7c6-4ba4-9fdb-6fe64c1db83e'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:16:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:16:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:16:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:16:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:16:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:16:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:16:56 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:16:56 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:16:57 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Jun 19 04:16:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.667s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:16:57 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:16:57 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Deleted volume successfully. Jun 19 04:16:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f7b52fea-7d72-4dab-a079-5355b5c2df25 tempest-ServersNegativeTestJSON-1955046281 None] Lock "cinder-4cd7dcbc-0faf-46a0-b045-3babfcc4fd8d-delete_volume" released by "delete_volume" :: held 2.817s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:04 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Flow 'volume_create_manager' (0d448713-9370-4358-bf01-47c922c82fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04172c28-6aed-4cfe-9001-70adc9f9866a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04172c28-6aed-4cfe-9001-70adc9f9866a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1348388709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92c293d-443e-4b7e-b297-5a8581b31987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09e517d9b154fa38ea4ff637ec64405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:05Z,use_quota=True,user_id='b2d375794e664f5c94b767d6a4443e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fec9d24-d851-4ff9-9275-bfc9d7767bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fec9d24-d851-4ff9-9275-bfc9d7767bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4497de7e-fd4f-4ca6-a414-93c76d713052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:04 devstack cinder-volume[93769]: DEBUG cinder.image.glance [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Creating Keystone auth plugin from conf {{(pid=93769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:17:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4497de7e-fd4f-4ca6-a414-93c76d713052) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b92c293d-443e-4b7e-b297-5a8581b31987', 'volume_name': 'volume-b92c293d-443e-4b7e-b297-5a8581b31987', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41bcf60-60b1-4254-a992-9c2b239d64ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d41bcf60-60b1-4254-a992-9c2b239d64ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519d456b-8844-4cd8-aa61-3541eee13880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:05 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Volume b92c293d-443e-4b7e-b297-5a8581b31987: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b92c293d-443e-4b7e-b297-5a8581b31987', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:17:05 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Trying to clone b92c293d-443e-4b7e-b297-5a8581b31987 from image f472f64e-f7ec-4170-b06c-8de073bddf2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]). {{(pid=93769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:17:06 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:17:06 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:17:06 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c647a164-c7a5-4155-b417-9dac402df091]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:06 devstack sudo[99777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD Jun 19 04:17:06 devstack sudo[99777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:07 devstack sudo[99777]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD" returned: 0 in 0.977s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:07 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Temporary image f472f64e-f7ec-4170-b06c-8de073bddf2f is fetched for user b2d375794e664f5c94b767d6a4443e62. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:17:07 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8448107-7b45-4849-ae46-8dc2600a777d]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:07 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD Jun 19 04:17:07 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:08 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD" returned: 0 in 0.833s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1348388709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b92c293d-443e-4b7e-b297-5a8581b31987,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b09e517d9b154fa38ea4ff637ec64405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:05Z,use_quota=True,user_id='b2d375794e664f5c94b767d6a4443e62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Creating volume b92c293d-443e-4b7e-b297-5a8581b31987 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:08 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:17:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:08 devstack sudo[99791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 1073741824 Jun 19 04:17:08 devstack sudo[99791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Flow 'volume_create_manager' (262122b9-11e2-4e69-920d-fddd423053d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb305267-0d89-41dc-b71f-f11b1a342298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb305267-0d89-41dc-b71f-f11b1a342298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1629956294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74bd64d-2fe4-43bb-a299-483f82cfabbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334398971ded4c8fb14a788d8cd022e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:09Z,use_quota=True,user_id='f9b5cbc73af443f8843dbdd40957235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1955813-b441-4487-bbf0-a462e7d43d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1955813-b441-4487-bbf0-a462e7d43d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebfbac5-3a95-4bc5-9a9e-5c0e0db7c00a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cebfbac5-3a95-4bc5-9a9e-5c0e0db7c00a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a74bd64d-2fe4-43bb-a299-483f82cfabbc', 'volume_name': 'volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106c94d2-9f30-4781-9bef-325f4577354c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (106c94d2-9f30-4781-9bef-325f4577354c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876e0bd5-fc54-410d-a615-e27a5076b9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:09 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Volume a74bd64d-2fe4-43bb-a299-483f82cfabbc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc', 'volume_size': 1} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:09 devstack sudo[99791]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 1073741824" returned: 0 in 1.196s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:09 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 Jun 19 04:17:09 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:10 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987" returned: 0 in 0.799s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] <== create_volume: return (2051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.055s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.047s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1629956294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a74bd64d-2fe4-43bb-a299-483f82cfabbc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334398971ded4c8fb14a788d8cd022e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:09Z,use_quota=True,user_id='f9b5cbc73af443f8843dbdd40957235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Creating volume a74bd64d-2fe4-43bb-a299-483f82cfabbc {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:10 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:10 devstack sudo[99801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc 1073741824 Jun 19 04:17:10 devstack sudo[99801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Attempting download of f472f64e-f7ec-4170-b06c-8de073bddf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}])) to volume b92c293d-443e-4b7e-b297-5a8581b31987. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4aec884-ea1b-4ccd-a83f-2c8d9df10a0b]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_j2qqbpac {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:10 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_j2qqbpac Jun 19 04:17:10 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:11 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_j2qqbpac" returned: 0 in 0.966s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_j2qqbpac {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:11 devstack sudo[99801]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc 1073741824" returned: 0 in 1.176s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:11 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_j2qqbpac Jun 19 04:17:11 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:11 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc Jun 19 04:17:11 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:12 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_j2qqbpac" returned: 1 in 0.869s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_j2qqbpac' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b73e8a5a-c23e-4898-8119-1d4f1aadadef]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:12 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc" returned: 0 in 0.814s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] <== create_volume: return (2073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.077s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (876e0bd5-fc54-410d-a615-e27a5076b9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32230891-9e5e-4db0-8dfa-7150edec70ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:12 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Volume volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc (a74bd64d-2fe4-43bb-a299-483f82cfabbc): created successfully Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32230891-9e5e-4db0-8dfa-7150edec70ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Flow 'volume_create_manager' (262122b9-11e2-4e69-920d-fddd423053d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:12 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-14404da5-3ad3-42d1-bdde-53e98458167d tempest-AttachVolumeTestJSON-2068967469 None] Created volume successfully. Jun 19 04:17:12 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD Jun 19 04:17:12 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:13 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD" returned: 0 in 0.885s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:13 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] f472f64e-f7ec-4170-b06c-8de073bddf2f was qcow2, converting to raw {{(pid=93769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:17:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:13 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 Jun 19 04:17:13 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Flow 'volume_create_manager' (c687ec87-5546-4b71-89f4-424c7093dcd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0086fe-42d6-42e4-b91f-9ba02bcca20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c0086fe-42d6-42e4-b91f-9ba02bcca20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1302314579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5427420f-4ca2-4f13-bbe9-e7e59d15561b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b972acc72ce4c8faeeba91cd426ed12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:14Z,use_quota=True,user_id='f5e6c44d46d54dd6a950addb4c6d57c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e630340-e905-46b3-a8e9-81f2058a9b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e630340-e905-46b3-a8e9-81f2058a9b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f19b65-5a80-42d9-ada8-6b4087fa1fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74f19b65-5a80-42d9-ada8-6b4087fa1fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5427420f-4ca2-4f13-bbe9-e7e59d15561b', 'volume_name': 'volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4b1250-0c3d-4eaf-9718-08fe3c9444a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee4b1250-0c3d-4eaf-9718-08fe3c9444a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9acdfba2-1945-4703-b184-d5ad4acc1aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:14 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Volume 5427420f-4ca2-4f13-bbe9-e7e59d15561b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b', 'volume_size': 1} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1302314579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5427420f-4ca2-4f13-bbe9-e7e59d15561b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b972acc72ce4c8faeeba91cd426ed12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:14Z,use_quota=True,user_id='f5e6c44d46d54dd6a950addb4c6d57c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Creating volume 5427420f-4ca2-4f13-bbe9-e7e59d15561b {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:14 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:17:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:14 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b 1073741824 Jun 19 04:17:14 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:15 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987" returned: 0 in 2.159s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:15 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_5mrs164qdevstack@QuobyteHD, size 112.00 MB, duration 2.16 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:17:15 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Converted 112.00 MB image at 51.86 MB/s Jun 19 04:17:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:15 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 1G Jun 19 04:17:15 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:15 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b 1073741824" returned: 0 in 0.884s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:15 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b Jun 19 04:17:15 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:16 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 1G" returned: 0 in 0.764s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:16 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b" returned: 0 in 0.667s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=48,cinder:SELECT=36,cinder:DELETE=5,cinder:INSERT=11 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9acdfba2-1945-4703-b184-d5ad4acc1aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aef071f-c620-432d-afca-e5e7b5d39b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b95ee83-fbf8-40c7-9ec9-f076678647d1]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:16 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Volume volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b (5427420f-4ca2-4f13-bbe9-e7e59d15561b): created successfully Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2aef071f-c620-432d-afca-e5e7b5d39b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Flow 'volume_create_manager' (c687ec87-5546-4b71-89f4-424c7093dcd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:16 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-8914452d-8dca-41f1-b012-166ee68be0bd req-7313d57c-1442-43a9-9575-6d50630e8499 tempest-VolumesSnapshotsTestJSON-1010210848 None] Created volume successfully. Jun 19 04:17:16 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 Jun 19 04:17:16 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-25de97eb-a482-4f3c-b19e-a2ff06262c72 req-4c403253-066b-4d76-99fd-ffb24d6c0928 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-25de97eb-a482-4f3c-b19e-a2ff06262c72 req-4c403253-066b-4d76-99fd-ffb24d6c0928 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63b30af-4364-44e2-b46f-9f61ac347c6c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-25de97eb-a482-4f3c-b19e-a2ff06262c72 req-4c403253-066b-4d76-99fd-ffb24d6c0928 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:16 devstack sudo[99879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc Jun 19 04:17:16 devstack sudo[99879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:16 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987" returned: 0 in 0.791s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:17 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 Jun 19 04:17:17 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:17 devstack sudo[99879]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-25de97eb-a482-4f3c-b19e-a2ff06262c72 req-4c403253-066b-4d76-99fd-ffb24d6c0928 tempest-AttachVolumeTestJSON-2068967469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc" returned: 0 in 0.845s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-25de97eb-a482-4f3c-b19e-a2ff06262c72 req-4c403253-066b-4d76-99fd-ffb24d6c0928 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.866s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.623s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=40,cinder:UPDATE=50,cinder:INSERT=13,cinder:DELETE=4 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Creating offline snapshot 061960da-80fa-436f-a3b0-36b9d81bedd9 of volume 5427420f-4ca2-4f13-bbe9-e7e59d15561b {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[726efca0-93c3-4eba-b1cf-63929b5ccb6b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-25de97eb-a482-4f3c-b19e-a2ff06262c72 req-4c403253-066b-4d76-99fd-ffb24d6c0928 tempest-AttachVolumeTestJSON-2068967469 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '38371bdf-dd04-47e0-94bb-6688aa791905', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:17:17 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-25de97eb-a482-4f3c-b19e-a2ff06262c72 req-4c403253-066b-4d76-99fd-ffb24d6c0928 tempest-AttachVolumeTestJSON-2068967469 None] attachment_update completed successfully. Jun 19 04:17:17 devstack sudo[99888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b Jun 19 04:17:17 devstack sudo[99888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:17 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987" returned: 1 in 0.774s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Downloaded image f472f64e-f7ec-4170-b06c-8de073bddf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}])) to volume b92c293d-443e-4b7e-b297-5a8581b31987 successfully. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Temporary image f472f64e-f7ec-4170-b06c-8de073bddf2f for user b2d375794e664f5c94b767d6a4443e62 is deleted. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Marking volume b92c293d-443e-4b7e-b297-5a8581b31987 as bootable. {{(pid=93769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Copying metadata from image f472f64e-f7ec-4170-b06c-8de073bddf2f to b92c293d-443e-4b7e-b297-5a8581b31987. {{(pid=93769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Creating volume glance metadata for volume b92c293d-443e-4b7e-b297-5a8581b31987 backed by image f472f64e-f7ec-4170-b06c-8de073bddf2f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (519d456b-8844-4cd8-aa61-3541eee13880) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b92c293d-443e-4b7e-b297-5a8581b31987', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc923d23-1716-4b5f-a5f2-f5d50fecc9f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:17 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Volume volume-b92c293d-443e-4b7e-b297-5a8581b31987 (b92c293d-443e-4b7e-b297-5a8581b31987): created successfully Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc923d23-1716-4b5f-a5f2-f5d50fecc9f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Flow 'volume_create_manager' (0d448713-9370-4358-bf01-47c922c82fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:17 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-88b05301-f8f7-4237-8930-c9fb8a38c2cc tempest-VolumesImageMetadata-2141525806 None] Created volume successfully. Jun 19 04:17:18 devstack sudo[99888]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b" returned: 0 in 0.793s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:18 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 1G Jun 19 04:17:18 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:19 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 1G" returned: 0 in 0.887s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:19 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 Jun 19 04:17:19 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Acquiring lock "cinder-b92c293d-443e-4b7e-b297-5a8581b31987-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Lock "cinder-b92c293d-443e-4b7e-b297-5a8581b31987-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Acquiring lock "cinder-quobyte-b92c293d-443e-4b7e-b297-5a8581b31987" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Lock "cinder-quobyte-b92c293d-443e-4b7e-b297-5a8581b31987" acquired by "delete_volume" :: waited 0.014s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:19 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[965fdd8c-4fba-4fee-a930-218207e9e382]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:19 devstack sudo[100289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 Jun 19 04:17:19 devstack sudo[100289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:20 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9" returned: 0 in 0.775s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:20 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 is being set with open permissions: ugo+rw Jun 19 04:17:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:20 devstack sudo[100295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 Jun 19 04:17:20 devstack sudo[100295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:20 devstack sudo[100289]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987" returned: 0 in 0.775s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:20 devstack sudo[100299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 Jun 19 04:17:20 devstack sudo[100299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:20 devstack sudo[100295]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9" returned: 0 in 0.726s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:20 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.info Jun 19 04:17:20 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:21 devstack sudo[100299]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987" returned: 1 in 0.835s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:17:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:21 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987 Jun 19 04:17:21 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:21 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.info" returned: 0 in 0.746s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:21 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.info is being set with open permissions: ugo+rw Jun 19 04:17:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:21 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.info Jun 19 04:17:21 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:21 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b92c293d-443e-4b7e-b297-5a8581b31987" returned: 0 in 0.669s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Lock "cinder-quobyte-b92c293d-443e-4b7e-b297-5a8581b31987" released by "delete_volume" :: held 2.351s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:21 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Created reservations ['fe555de8-449c-4607-b1d2-192fa349d8dd', '5d7eb945-ca15-4f41-a5ed-0e0a879a1b67', 'a65b08c5-a93d-4603-8aab-db80df4f4852', '34b680d9-7588-4e28-8770-df879307ea6c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:22 devstack sudo[100314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:17:22 devstack sudo[100314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:22 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.info" returned: 0 in 0.689s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.734s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-09535575-aa0c-49ae-8752-e27ab04e4b7d req-97988b97-34d5-4d8d-8c3f-28b9e8656367 tempest-VolumesSnapshotsTestJSON-1010210848 None] Create snapshot completed successfully Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Acquiring lock "cinder-061960da-80fa-436f-a3b0-36b9d81bedd9-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-061960da-80fa-436f-a3b0-36b9d81bedd9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Acquiring lock "cinder-quobyte-5427420f-4ca2-4f13-bbe9-e7e59d15561b" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-quobyte-5427420f-4ca2-4f13-bbe9-e7e59d15561b" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Acquiring lock "cinder-quobyte-061960da-80fa-436f-a3b0-36b9d81bedd9" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-quobyte-061960da-80fa-436f-a3b0-36b9d81bedd9" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Deleting offline snapshot 061960da-80fa-436f-a3b0-36b9d81bedd9 of volume 5427420f-4ca2-4f13-bbe9-e7e59d15561b {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] snapshot_file for this snap is: volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3242608d-6692-47fb-b581-5ed728ca9107]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:22 devstack sudo[100314]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.732s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Deleted volume successfully. Jun 19 04:17:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-72e6a8bc-ec45-4aa6-bd16-ba0391b56a34 tempest-VolumesImageMetadata-2141525806 None] Lock "cinder-b92c293d-443e-4b7e-b297-5a8581b31987-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:22 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 Jun 19 04:17:22 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Flow 'volume_create_manager' (c2dfbff1-10f3-4115-b50b-387ca30784a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3da914-4794-4982-8659-3712343a64e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3da914-4794-4982-8659-3712343a64e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2051320128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db56c1e-9070-4671-9d0c-a86e238d927b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334398971ded4c8fb14a788d8cd022e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:23Z,use_quota=True,user_id='f9b5cbc73af443f8843dbdd40957235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57dac57-1987-42fa-be02-c6a874b9d0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c57dac57-1987-42fa-be02-c6a874b9d0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a189e091-daf5-4022-afd8-9211276259cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a189e091-daf5-4022-afd8-9211276259cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6db56c1e-9070-4671-9d0c-a86e238d927b', 'volume_name': 'volume-6db56c1e-9070-4671-9d0c-a86e238d927b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda23daa-5cf1-42bc-b920-83d5b8bd36c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dda23daa-5cf1-42bc-b920-83d5b8bd36c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7902915-6f11-42d5-b4d3-4a4d8680f5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:23 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Volume 6db56c1e-9070-4671-9d0c-a86e238d927b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6db56c1e-9070-4671-9d0c-a86e238d927b', 'volume_size': 1} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2051320128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6db56c1e-9070-4671-9d0c-a86e238d927b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='334398971ded4c8fb14a788d8cd022e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:23Z,use_quota=True,user_id='f9b5cbc73af443f8843dbdd40957235b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Creating volume 6db56c1e-9070-4671-9d0c-a86e238d927b {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:23 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:23 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b 1073741824 Jun 19 04:17:23 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:23 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9" returned: 0 in 1.006s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e7639fb-39be-4564-90d7-7faec94aecc5]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:23 devstack sudo[100327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b Jun 19 04:17:23 devstack sudo[100327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:24 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b 1073741824" returned: 0 in 0.983s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:24 devstack sudo[100348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b Jun 19 04:17:24 devstack sudo[100348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:24 devstack sudo[100327]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b" returned: 0 in 1.097s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:24 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 Jun 19 04:17:24 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:25 devstack sudo[100348]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b" returned: 0 in 0.816s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7902915-6f11-42d5-b4d3-4a4d8680f5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6db56c1e-9070-4671-9d0c-a86e238d927b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db10aca-4f8b-4881-a225-dc23973cb823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:25 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Volume volume-6db56c1e-9070-4671-9d0c-a86e238d927b (6db56c1e-9070-4671-9d0c-a86e238d927b): created successfully Jun 19 04:17:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9db10aca-4f8b-4881-a225-dc23973cb823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Flow 'volume_create_manager' (c2dfbff1-10f3-4115-b50b-387ca30784a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9be81042-0b0d-43a2-8ac1-4011c0fa7bd1 tempest-AttachVolumeTestJSON-2068967469 None] Created volume successfully. Jun 19 04:17:25 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9" returned: 0 in 0.829s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:25 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9 Jun 19 04:17:25 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Flow 'volume_create_manager' (63067765-f818-4f0d-a9a9-6de6eb71d102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d76aef-7214-4c33-8afd-fa567212ba6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d76aef-7214-4c33-8afd-fa567212ba6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1847301293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbad59a-56ae-4882-bdbf-3d3271e91cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47195720a56e4c2d805e3aea077144fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:26Z,use_quota=True,user_id='61543da3a8e547eda12399c1f77087a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f139200d-1c48-4e8f-ad99-38b64e6e92e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f139200d-1c48-4e8f-ad99-38b64e6e92e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c225e3c2-6b16-4f54-a85e-ca4e39f4df7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:26 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c225e3c2-6b16-4f54-a85e-ca4e39f4df7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dbad59a-56ae-4882-bdbf-3d3271e91cbd', 'volume_name': 'volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c262b80c-313c-4e44-acdc-cab9389e6523) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c262b80c-313c-4e44-acdc-cab9389e6523) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d50a51-71f3-484f-b244-421dcd4120e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:26 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Volume 3dbad59a-56ae-4882-bdbf-3d3271e91cbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd', 'volume_size': 1} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1847301293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbad59a-56ae-4882-bdbf-3d3271e91cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47195720a56e4c2d805e3aea077144fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:26Z,use_quota=True,user_id='61543da3a8e547eda12399c1f77087a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Creating volume 3dbad59a-56ae-4882-bdbf-3d3271e91cbd {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:26 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b.061960da-80fa-436f-a3b0-36b9d81bedd9" returned: 0 in 0.810s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:26 devstack sudo[100365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd 1073741824 Jun 19 04:17:26 devstack sudo[100365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-quobyte-061960da-80fa-436f-a3b0-36b9d81bedd9" released by "_delete_snapshot" :: held 3.912s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-quobyte-5427420f-4ca2-4f13-bbe9-e7e59d15561b" released by "delete_snapshot" :: held 3.980s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.quota [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Created reservations ['f1008842-4ae7-4969-b6e2-ba4c6dcf52c5', '3e780cd4-1d92-4ef8-8b8d-4c2b029da2b7', 'e8dea0ee-bb79-4d94-a4df-59a8f5878ac9', 'b3c2b81c-eb93-4c9c-b43d-b35600797c3d'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:26 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Delete snapshot completed successfully. Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-5a6e519b-b26b-426d-b43c-0ad1753fc5dd req-878165bd-d2b4-4248-bb13-fdde89dd53a1 tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-061960da-80fa-436f-a3b0-36b9d81bedd9-delete_snapshot" released by "delete_snapshot" :: held 4.316s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Flow 'volume_create_manager' (5fe2a01a-a23e-41db-a470-e5bfd1fc8fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841a8721-67e5-47c8-b3b1-42ca19dceef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841a8721-67e5-47c8-b3b1-42ca19dceef9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2052787211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21730874-f9a1-491b-8e35-7e0c4c2eef57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c71bd9c7b749b99cfe5f536ba29f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:27Z,use_quota=True,user_id='410022a373554ecfa737055ca68244df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0cbb16-dc5a-46f2-9cc9-e71f6de4a7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc0cbb16-dc5a-46f2-9cc9-e71f6de4a7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c04524-322a-4bc0-9a94-7ed69346fa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1c04524-322a-4bc0-9a94-7ed69346fa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21730874-f9a1-491b-8e35-7e0c4c2eef57', 'volume_name': 'volume-21730874-f9a1-491b-8e35-7e0c4c2eef57', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb7fcf9-745a-4e7c-a8d3-afd46167bae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceb7fcf9-745a-4e7c-a8d3-afd46167bae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a03433-8910-4c61-9aa9-ff440d81948f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:27 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Volume 21730874-f9a1-491b-8e35-7e0c4c2eef57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21730874-f9a1-491b-8e35-7e0c4c2eef57', 'volume_size': 1} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Acquiring lock "cinder-5427420f-4ca2-4f13-bbe9-e7e59d15561b-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-5427420f-4ca2-4f13-bbe9-e7e59d15561b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Acquiring lock "cinder-quobyte-5427420f-4ca2-4f13-bbe9-e7e59d15561b" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-quobyte-5427420f-4ca2-4f13-bbe9-e7e59d15561b" acquired by "delete_volume" :: waited 0.033s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a726e2-3d54-40d5-b950-140170f65889]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:27 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b Jun 19 04:17:27 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:27 devstack sudo[100365]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd 1073741824" returned: 0 in 1.266s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:27 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd Jun 19 04:17:27 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:28 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b" returned: 0 in 0.964s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:28 devstack sudo[100382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b Jun 19 04:17:28 devstack sudo[100382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:28 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" returned: 0 in 0.714s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] <== create_volume: return (2026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.029s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.427s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-2052787211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21730874-f9a1-491b-8e35-7e0c4c2eef57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51c71bd9c7b749b99cfe5f536ba29f78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:27Z,use_quota=True,user_id='410022a373554ecfa737055ca68244df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Creating volume 21730874-f9a1-491b-8e35-7e0c4c2eef57 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:28 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c8d50a51-71f3-484f-b244-421dcd4120e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e7b178-cd06-47de-bcb5-1bddfce22f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:28 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 1073741824 Jun 19 04:17:28 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:28 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Volume volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd (3dbad59a-56ae-4882-bdbf-3d3271e91cbd): created successfully Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53e7b178-cd06-47de-bcb5-1bddfce22f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Flow 'volume_create_manager' (63067765-f818-4f0d-a9a9-6de6eb71d102) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-8892f624-6ed6-453d-a19f-b55a3509a388 tempest-SnapshotMetadataTestJSON-1018956010 None] Created volume successfully. Jun 19 04:17:29 devstack sudo[100382]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5427420f-4ca2-4f13-bbe9-e7e59d15561b" returned: 0 in 0.742s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-quobyte-5427420f-4ca2-4f13-bbe9-e7e59d15561b" released by "delete_volume" :: held 1.800s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG cinder.quota [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Created reservations ['dd35ee2c-cbec-4342-be08-671c8330de0b', '8babef01-8fae-418d-8377-57ef96ff80b1', '640d07d0-74a0-402d-81eb-a76a58d33d6c', 'c71468f5-9986-4d88-9ac0-046a0c2365cc'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:29 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:17:29 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:29 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 1073741824" returned: 0 in 1.038s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:29 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 Jun 19 04:17:29 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-72f9ba1a-d2ca-4ed3-b4b2-b31593e91cd8 req-786e5db2-cd11-4ce8-bcd9-e8dc39d2dffd tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:30 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.989s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG cinder.manager [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:30 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Deleted volume successfully. Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-4447362b-2272-483f-8727-9ca977a08af1 req-fd9424e0-be97-4ec0-9a95-e31fdcab21ca tempest-VolumesSnapshotsTestJSON-1010210848 None] Lock "cinder-5427420f-4ca2-4f13-bbe9-e7e59d15561b-delete_volume" released by "delete_volume" :: held 3.108s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:30 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57" returned: 0 in 0.835s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.973s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.519s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89a03433-8910-4c61-9aa9-ff440d81948f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21730874-f9a1-491b-8e35-7e0c4c2eef57', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772ea44d-53f7-415d-afca-39b692a30ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Creating offline snapshot 07bac0d0-3fd5-4c78-9304-5acba87d1fb5 of volume 3dbad59a-56ae-4882-bdbf-3d3271e91cbd {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:17:30 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Volume volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 (21730874-f9a1-491b-8e35-7e0c4c2eef57): created successfully Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (772ea44d-53f7-415d-afca-39b692a30ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Flow 'volume_create_manager' (5fe2a01a-a23e-41db-a470-e5bfd1fc8fa5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4da3b3b-e1cd-47e2-a35e-d5bbc60c2cc6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:30 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-94fbd813-e48c-4e11-9fa4-2baf1a61995b tempest-ServerActionsTestOtherA-2120436923 None] Created volume successfully. Jun 19 04:17:30 devstack sudo[100410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd Jun 19 04:17:30 devstack sudo[100410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:31 devstack sudo[100410]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" returned: 0 in 0.823s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:31 devstack sudo[100416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 1G Jun 19 04:17:31 devstack sudo[100416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:32 devstack sudo[100416]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 1G" returned: 0 in 0.906s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:32 devstack sudo[100423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 Jun 19 04:17:32 devstack sudo[100423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:33 devstack sudo[100423]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5" returned: 0 in 0.743s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:33 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 is being set with open permissions: ugo+rw Jun 19 04:17:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:33 devstack sudo[100428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 Jun 19 04:17:33 devstack sudo[100428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:33 devstack sudo[100428]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5" returned: 0 in 0.674s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:33 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.info Jun 19 04:17:33 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:34 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-68dbb339-07ff-4377-9636-7b063f062493 tempest-GroupSnapshotsV319Test-640330754 None] Group tempest-GroupSnapshotsV319Test-Group-995723331: creating Jun 19 04:17:34 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-68dbb339-07ff-4377-9636-7b063f062493 tempest-GroupSnapshotsV319Test-640330754 None] Group tempest-GroupSnapshotsV319Test-Group-995723331: created successfully Jun 19 04:17:34 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-68dbb339-07ff-4377-9636-7b063f062493 tempest-GroupSnapshotsV319Test-640330754 None] Create group completed successfully. Jun 19 04:17:34 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.info" returned: 0 in 0.711s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:34 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.info is being set with open permissions: ugo+rw Jun 19 04:17:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:34 devstack sudo[100434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.info Jun 19 04:17:34 devstack sudo[100434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:35 devstack sudo[100434]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.info" returned: 0 in 0.632s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.669s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-72f9ba1a-d2ca-4ed3-b4b2-b31593e91cd8 req-786e5db2-cd11-4ce8-bcd9-e8dc39d2dffd tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.058s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa01015a-b202-4dd7-bd44-3245762bbb37]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-72f9ba1a-d2ca-4ed3-b4b2-b31593e91cd8 req-786e5db2-cd11-4ce8-bcd9-e8dc39d2dffd tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:35 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5a7c05c7-95c1-4f66-9533-1b6612dbfa4a tempest-SnapshotMetadataTestJSON-1018956010 None] Create snapshot completed successfully Jun 19 04:17:35 devstack sudo[100437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b Jun 19 04:17:35 devstack sudo[100437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:36 devstack sudo[100437]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-72f9ba1a-d2ca-4ed3-b4b2-b31593e91cd8 req-786e5db2-cd11-4ce8-bcd9-e8dc39d2dffd tempest-AttachVolumeTestJSON-2068967469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b" returned: 0 in 0.878s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-72f9ba1a-d2ca-4ed3-b4b2-b31593e91cd8 req-786e5db2-cd11-4ce8-bcd9-e8dc39d2dffd tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.897s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Flow 'volume_create_manager' (b401418a-e7d6-40c0-a737-7ac900b1f2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5ec813-04ea-47cc-975a-7107747f9de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a5ec813-04ea-47cc-975a-7107747f9de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1425392352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55a856fb-43a5-4276-9d93-6acfe28517a8,host='devstack@QuobyteHD#QuobyteHD',id=e10887ff-e955-4861-b00e-5cffd84b2f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5efcca3af64655a36a19e1ae538371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:36Z,use_quota=True,user_id='f1a2937b3ceb4542ba879bee4a40290e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(273a2baa-e2b5-45c1-8d7b-5ed1885615a0),volume_type_id=273a2baa-e2b5-45c1-8d7b-5ed1885615a0)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5e8caf-9228-4831-9c65-682b36c9f19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab5e8caf-9228-4831-9c65-682b36c9f19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b020860-e4f0-4193-8180-ce61aee01e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b020860-e4f0-4193-8180-ce61aee01e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e10887ff-e955-4861-b00e-5cffd84b2f2f', 'volume_name': 'volume-e10887ff-e955-4861-b00e-5cffd84b2f2f', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28583022-dd41-422b-85c4-65c837e5af6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28583022-dd41-422b-85c4-65c837e5af6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e7d965-9d17-4200-8018-e74a06552365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Volume e10887ff-e955-4861-b00e-5cffd84b2f2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e10887ff-e955-4861-b00e-5cffd84b2f2f', 'volume_size': 1} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=55a856fb-43a5-4276-9d93-6acfe28517a8,created_at=2026-06-19T02:17:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1425392352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=55a856fb-43a5-4276-9d93-6acfe28517a8,host='devstack@QuobyteHD#QuobyteHD',id=e10887ff-e955-4861-b00e-5cffd84b2f2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d5efcca3af64655a36a19e1ae538371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:36Z,use_quota=True,user_id='f1a2937b3ceb4542ba879bee4a40290e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(273a2baa-e2b5-45c1-8d7b-5ed1885615a0),volume_type_id=273a2baa-e2b5-45c1-8d7b-5ed1885615a0)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Creating volume e10887ff-e955-4861-b00e-5cffd84b2f2f {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:36 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:36 devstack sudo[100442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f 1073741824 Jun 19 04:17:36 devstack sudo[100442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-72f9ba1a-d2ca-4ed3-b4b2-b31593e91cd8 req-786e5db2-cd11-4ce8-bcd9-e8dc39d2dffd tempest-AttachVolumeTestJSON-2068967469 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-6db56c1e-9070-4671-9d0c-a86e238d927b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f0a899e6-01ff-401c-9ef9-b6ef11eefeb4', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:17:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-72f9ba1a-d2ca-4ed3-b4b2-b31593e91cd8 req-786e5db2-cd11-4ce8-bcd9-e8dc39d2dffd tempest-AttachVolumeTestJSON-2068967469 None] attachment_update completed successfully. Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Acquiring lock "cinder-07bac0d0-3fd5-4c78-9304-5acba87d1fb5-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-07bac0d0-3fd5-4c78-9304-5acba87d1fb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Acquiring lock "cinder-quobyte-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-quobyte-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Acquiring lock "cinder-quobyte-07bac0d0-3fd5-4c78-9304-5acba87d1fb5" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-quobyte-07bac0d0-3fd5-4c78-9304-5acba87d1fb5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Deleting offline snapshot 07bac0d0-3fd5-4c78-9304-5acba87d1fb5 of volume 3dbad59a-56ae-4882-bdbf-3d3271e91cbd {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] snapshot_file for this snap is: volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e24ad4-e3a4-4441-93dc-7ddca329ebd3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:37 devstack sudo[100442]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:37 devstack sudo[100449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 Jun 19 04:17:37 devstack sudo[100449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f 1073741824" returned: 0 in 1.197s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:37 devstack sudo[100454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f Jun 19 04:17:37 devstack sudo[100454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:38 devstack sudo[100454]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f" returned: 0 in 0.885s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] <== create_volume: return (2158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.160s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:38 devstack sudo[100449]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94e7d965-9d17-4200-8018-e74a06552365) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e10887ff-e955-4861-b00e-5cffd84b2f2f', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31443c71-692b-4a73-8a95-a8c7bc02e77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5" returned: 0 in 1.195s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b3a6d93-6eed-4688-96a6-f11b8ac36e42]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:38 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Volume volume-e10887ff-e955-4861-b00e-5cffd84b2f2f (e10887ff-e955-4861-b00e-5cffd84b2f2f): created successfully Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31443c71-692b-4a73-8a95-a8c7bc02e77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Flow 'volume_create_manager' (b401418a-e7d6-40c0-a737-7ac900b1f2e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5a6991e7-8a61-4476-acd8-7f98ef203bb6 tempest-GroupSnapshotsV319Test-640330754 None] Created volume successfully. Jun 19 04:17:38 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd Jun 19 04:17:38 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:39 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" returned: 0 in 0.856s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:39 devstack sudo[100513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 Jun 19 04:17:39 devstack sudo[100513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] GroupSnapshot 8c69a6fc-16f5-4ef7-99bc-fd467c060aad: creating. Jun 19 04:17:40 devstack sudo[100513]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5" returned: 0 in 0.762s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:40 devstack sudo[100518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5 Jun 19 04:17:40 devstack sudo[100518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Group snapshot 8c69a6fc-16f5-4ef7-99bc-fd467c060aad: creating. {{(pid=93769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Creating offline snapshot 5ab679c5-abdc-4462-9094-311136309a28 of volume e10887ff-e955-4861-b00e-5cffd84b2f2f {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[864488b6-9cea-4e14-83f1-cafbd8964a4a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:40 devstack sudo[100520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f Jun 19 04:17:40 devstack sudo[100520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:40 devstack sudo[100518]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd.07bac0d0-3fd5-4c78-9304-5acba87d1fb5" returned: 0 in 0.696s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-quobyte-07bac0d0-3fd5-4c78-9304-5acba87d1fb5" released by "_delete_snapshot" :: held 3.696s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-quobyte-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" released by "delete_snapshot" :: held 3.727s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Created reservations ['d502f1ef-c233-4770-90b5-013d7346a94d', 'df511de4-8176-42b3-8923-8b29898bff7e', '83f1bb5d-7b36-404b-8e21-c906b154a5e6', 'abf29f50-05c7-4358-86d5-ed639f63b51a'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Delete snapshot completed successfully. Jun 19 04:17:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61c2e56c-7a40-484c-84b6-7e62aed25b16 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-07bac0d0-3fd5-4c78-9304-5acba87d1fb5-delete_snapshot" released by "delete_snapshot" :: held 3.916s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:41 devstack sudo[100520]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f" returned: 0 in 0.904s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:41 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 1G Jun 19 04:17:41 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Acquiring lock "cinder-3dbad59a-56ae-4882-bdbf-3d3271e91cbd-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-3dbad59a-56ae-4882-bdbf-3d3271e91cbd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Acquiring lock "cinder-quobyte-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-quobyte-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2be75a-3147-4851-9d60-cd8b910f4aa4]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:41 devstack sudo[100533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd Jun 19 04:17:41 devstack sudo[100533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:41 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 1G" returned: 0 in 0.930s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e10887ff-e955-4861-b00e-5cffd84b2f2f -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:41 devstack sudo[100539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:17:41 devstack sudo[100539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:41 devstack sudo[100541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e10887ff-e955-4861-b00e-5cffd84b2f2f -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 Jun 19 04:17:41 devstack sudo[100541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:42 devstack sudo[100533]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" returned: 0 in 0.982s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:42 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd Jun 19 04:17:42 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:42 devstack sudo[100539]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.792s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:17:42 devstack sudo[100541]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e10887ff-e955-4861-b00e-5cffd84b2f2f -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28" returned: 0 in 0.825s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:42 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:42 devstack sudo[100562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 Jun 19 04:17:42 devstack sudo[100562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:42 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-6a83b92d-af05-490f-afde-91705a7d95f9 req-49d50e7d-296a-4319-9eac-9ee46aa1d3e2 tempest-AttachVolumeTestJSON-2068967469 None] Terminate volume connection completed successfully. Jun 19 04:17:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-6a83b92d-af05-490f-afde-91705a7d95f9 req-49d50e7d-296a-4319-9eac-9ee46aa1d3e2 tempest-AttachVolumeTestJSON-2068967469 None] Deleting attachment 38371bdf-dd04-47e0-94bb-6688aa791905. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:17:43 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" returned: 0 in 0.682s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-quobyte-3dbad59a-56ae-4882-bdbf-3d3271e91cbd" released by "delete_volume" :: held 1.725s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Created reservations ['43074a7f-7724-498a-960e-4ce8b08cc60f', 'bb042386-5c7f-458e-a24d-b4af260f5dd6', '5d69f3b3-df3f-41f7-8f45-6602b2733fa5', '500f7692-5440-4034-a9e7-b7f21619e05d'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:43 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:17:43 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:43 devstack sudo[100562]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28" returned: 0 in 0.763s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:43 devstack sudo[100570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.info Jun 19 04:17:43 devstack sudo[100570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:44 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.825s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:44 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Deleted volume successfully. Jun 19 04:17:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24b29576-6358-496a-8d0a-e82d47de5a54 tempest-SnapshotMetadataTestJSON-1018956010 None] Lock "cinder-3dbad59a-56ae-4882-bdbf-3d3271e91cbd-delete_volume" released by "delete_volume" :: held 2.768s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:44 devstack sudo[100570]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.info" returned: 0 in 0.771s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:44 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:17:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:44 devstack sudo[100585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.info Jun 19 04:17:44 devstack sudo[100585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:45 devstack sudo[100585]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.info" returned: 0 in 0.954s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.243s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-4250cdf1-3e0f-4943-9002-c6e064f73a74 tempest-GroupSnapshotsV319Test-640330754 None] group_snapshot 8c69a6fc-16f5-4ef7-99bc-fd467c060aad: created successfully Jun 19 04:17:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-f84ed49d-bac5-4bda-a61d-b83f8ca04900 req-46d9a270-0c41-4798-aa22-942545ea1c9a tempest-AttachVolumeTestJSON-2068967469 None] Terminate volume connection completed successfully. Jun 19 04:17:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-f84ed49d-bac5-4bda-a61d-b83f8ca04900 req-46d9a270-0c41-4798-aa22-942545ea1c9a tempest-AttachVolumeTestJSON-2068967469 None] Deleting attachment f0a899e6-01ff-401c-9ef9-b6ef11eefeb4. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:17:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] group_snapshot 8c69a6fc-16f5-4ef7-99bc-fd467c060aad: deleting Jun 19 04:17:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] group_snapshot 8c69a6fc-16f5-4ef7-99bc-fd467c060aad: deleting {{(pid=93769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:17:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Acquiring lock "cinder-quobyte-e10887ff-e955-4861-b00e-5cffd84b2f2f" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Lock "cinder-quobyte-e10887ff-e955-4861-b00e-5cffd84b2f2f" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Acquiring lock "cinder-quobyte-5ab679c5-abdc-4462-9094-311136309a28" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Lock "cinder-quobyte-5ab679c5-abdc-4462-9094-311136309a28" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Deleting offline snapshot 5ab679c5-abdc-4462-9094-311136309a28 of volume e10887ff-e955-4861-b00e-5cffd84b2f2f {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:17:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] snapshot_file for this snap is: volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:17:47 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f835f6d-f37f-4f52-868f-7eeaa87f6ce0]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:47 devstack sudo[100639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 Jun 19 04:17:47 devstack sudo[100639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:48 devstack sudo[100639]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28" returned: 0 in 1.035s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e10887ff-e955-4861-b00e-5cffd84b2f2f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:17:48 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7510d05-8451-47db-95f8-bd666685c98c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:48 devstack sudo[100646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f Jun 19 04:17:48 devstack sudo[100646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:49 devstack sudo[100646]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f" returned: 0 in 1.181s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:49 devstack sudo[100659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 Jun 19 04:17:49 devstack sudo[100659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:50 devstack sudo[100659]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28" returned: 0 in 1.238s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:50 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28 Jun 19 04:17:50 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Flow 'volume_create_manager' (1c894c12-1fcd-44a2-80ca-ef9bf229b9c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e1b823-797f-4660-b64e-78bb82cc472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5e1b823-797f-4660-b64e-78bb82cc472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-720174481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58636472-7823-43df-8bae-be2c050cddb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221d2bc306e5401198d557f38d87a2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:51Z,use_quota=True,user_id='9af24b4d9bfd41c09cd9c416a85d93b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4c7623-b17a-4e07-839a-3a5dde813f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4c7623-b17a-4e07-839a-3a5dde813f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ac5773-092f-4ffd-af43-0b6ceb91d349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72ac5773-092f-4ffd-af43-0b6ceb91d349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58636472-7823-43df-8bae-be2c050cddb2', 'volume_name': 'volume-58636472-7823-43df-8bae-be2c050cddb2', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f23831-b994-490c-9da3-9ae2209db831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40f23831-b994-490c-9da3-9ae2209db831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9678577-509a-4d48-8bf9-9ea6fc3616e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:51 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Volume 58636472-7823-43df-8bae-be2c050cddb2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58636472-7823-43df-8bae-be2c050cddb2', 'volume_size': 1} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:17:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-720174481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58636472-7823-43df-8bae-be2c050cddb2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221d2bc306e5401198d557f38d87a2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:17:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:17:51Z,use_quota=True,user_id='9af24b4d9bfd41c09cd9c416a85d93b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Creating volume 58636472-7823-43df-8bae-be2c050cddb2 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:17:51 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:51 devstack sudo[100705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2 1073741824 Jun 19 04:17:51 devstack sudo[100705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:51 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f.5ab679c5-abdc-4462-9094-311136309a28" returned: 0 in 1.211s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Lock "cinder-quobyte-5ab679c5-abdc-4462-9094-311136309a28" released by "_delete_snapshot" :: held 4.890s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Lock "cinder-quobyte-e10887ff-e955-4861-b00e-5cffd84b2f2f" released by "delete_snapshot" :: held 4.928s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:52 devstack cinder-volume[93769]: WARNING cinder.quota [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1966257237 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1966257237, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:52 devstack cinder-volume[93769]: WARNING cinder.quota [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1966257237 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1966257237, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:52 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] Created reservations ['cb8786f2-763d-487e-b36f-185135ab99dc', 'a8a2d5cd-1e6b-4cf3-b682-45d6ad04665c', 'ffcde7b0-df26-4348-8f91-567b896feeef', '13e7c017-0fac-47cc-8a6b-614c274d3b87'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:52 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-89a57a6e-6964-465e-8d8a-104ecbc9c6c1 tempest-GroupSnapshotsV319Test-640330754 None] group_snapshot 8c69a6fc-16f5-4ef7-99bc-fd467c060aad: deleted successfully Jun 19 04:17:53 devstack sudo[100705]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2 1073741824" returned: 0 in 1.616s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:53 devstack sudo[100720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2 Jun 19 04:17:53 devstack sudo[100720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Acquiring lock "cinder-quobyte-e10887ff-e955-4861-b00e-5cffd84b2f2f" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Lock "cinder-quobyte-e10887ff-e955-4861-b00e-5cffd84b2f2f" acquired by "delete_volume" :: waited 0.039s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:53 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[70b1ee72-cf13-4289-ae3c-5e1a82ffb7f3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:53 devstack sudo[100722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f Jun 19 04:17:53 devstack sudo[100722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:54 devstack sudo[100720]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2" returned: 0 in 0.862s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] <== create_volume: return (2566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:17:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.573s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9678577-509a-4d48-8bf9-9ea6fc3616e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58636472-7823-43df-8bae-be2c050cddb2', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f60ef35-be0c-417c-9e67-cf8e892f051c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:17:54 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Volume volume-58636472-7823-43df-8bae-be2c050cddb2 (58636472-7823-43df-8bae-be2c050cddb2): created successfully Jun 19 04:17:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f60ef35-be0c-417c-9e67-cf8e892f051c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:17:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Flow 'volume_create_manager' (1c894c12-1fcd-44a2-80ca-ef9bf229b9c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:17:54 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ab44afee-9f09-45f3-8173-f7dc30358f4b tempest-VolumesTransfersV355Test-1624921708 None] Created volume successfully. Jun 19 04:17:54 devstack sudo[100722]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f" returned: 0 in 0.956s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:54 devstack sudo[100729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f Jun 19 04:17:54 devstack sudo[100729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:55 devstack sudo[100729]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e10887ff-e955-4861-b00e-5cffd84b2f2f" returned: 0 in 0.825s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Lock "cinder-quobyte-e10887ff-e955-4861-b00e-5cffd84b2f2f" released by "delete_volume" :: held 1.867s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Created reservations ['1ee51c29-ed76-4062-bffe-efeb714033cc'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:55 devstack cinder-volume[93769]: WARNING cinder.quota [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1966257237 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1966257237, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Created reservations ['a882cebf-fd2d-4be5-b9fe-961959401cc5', 'e3d392cd-feed-4b1a-b7c4-8a87333892f0', '914451ef-6dcb-4592-bc26-c65d4310eb73', 'd2ac80ae-1ddf-4e7c-9a18-ba3ef7f0141e'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:55 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3ed1dae5-1380-4fc0-84ae-931a12bbab2b tempest-VolumesTransfersV355Test-231064185 None] Transfer volume completed successfully. Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:55 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:17:55 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:56 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.706s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:56 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:17:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e9831e17-5e7d-481e-ba28-b95832f8fe30 tempest-GroupSnapshotsV319Test-640330754 None] Delete group completed successfully. Jun 19 04:17:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Acquiring lock "cinder-58636472-7823-43df-8bae-be2c050cddb2-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Lock "cinder-58636472-7823-43df-8bae-be2c050cddb2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Acquiring lock "cinder-quobyte-58636472-7823-43df-8bae-be2c050cddb2" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Lock "cinder-quobyte-58636472-7823-43df-8bae-be2c050cddb2" acquired by "delete_volume" :: waited 0.044s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3530ec47-06a0-4d29-a63c-35815f320c29]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:57 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2 Jun 19 04:17:57 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "cinder-6db56c1e-9070-4671-9d0c-a86e238d927b-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-6db56c1e-9070-4671-9d0c-a86e238d927b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:58 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2" returned: 0 in 1.381s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "cinder-quobyte-6db56c1e-9070-4671-9d0c-a86e238d927b" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:17:58 devstack sudo[100741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2 Jun 19 04:17:58 devstack sudo[100741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-quobyte-6db56c1e-9070-4671-9d0c-a86e238d927b" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:17:58 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[683ef786-0b88-4a32-8607-2cfc5e5caf44]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:17:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:58 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b Jun 19 04:17:58 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:59 devstack sudo[100741]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-58636472-7823-43df-8bae-be2c050cddb2" returned: 0 in 0.865s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Lock "cinder-quobyte-58636472-7823-43df-8bae-be2c050cddb2" released by "delete_volume" :: held 2.320s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Created reservations ['56a8b7cc-6abc-47e8-bd68-82d31fd2b281', '3c75a15c-9d3d-461d-9c5c-e8e0559eddfb', '783fd8cf-8796-4e27-9328-b3bb6e2ad81b', 'c37b4dcf-9de5-48a3-a8b4-a998f9ea3d6a'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:59 devstack sudo[100766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:17:59 devstack sudo[100766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:17:59 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b" returned: 0 in 1.182s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:17:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:17:59 devstack sudo[100770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b Jun 19 04:17:59 devstack sudo[100770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:00 devstack sudo[100766]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.784s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:00 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Deleted volume successfully. Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1aea51bb-432f-4dfa-99eb-ccc6f217f322 tempest-VolumesTransfersV355Test-1555841835 None] Lock "cinder-58636472-7823-43df-8bae-be2c050cddb2-delete_volume" released by "delete_volume" :: held 3.431s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:00 devstack sudo[100770]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6db56c1e-9070-4671-9d0c-a86e238d927b" returned: 0 in 0.716s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-quobyte-6db56c1e-9070-4671-9d0c-a86e238d927b" released by "delete_volume" :: held 1.949s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Created reservations ['6b5039c3-873e-4fd8-976f-f49a393640fd', 'a30c1360-5330-41ed-8c5b-ac03e2f771b7', '86675566-7d05-49ee-8a85-8a718174b8a0', 'f6be3de7-85ec-4ade-a725-edbe1b747db5'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:00 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:00 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "cinder-a74bd64d-2fe4-43bb-a299-483f82cfabbc-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-a74bd64d-2fe4-43bb-a299-483f82cfabbc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "cinder-quobyte-a74bd64d-2fe4-43bb-a299-483f82cfabbc" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-quobyte-a74bd64d-2fe4-43bb-a299-483f82cfabbc" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3d1886d-e99d-43b2-99ce-202d192941d0]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:00 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc Jun 19 04:18:00 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Flow 'volume_create_manager' (01101595-d919-4734-a9cb-7dd8907b714b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fca9a7-53cb-494e-a470-8a46c2bc7822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fca9a7-53cb-494e-a470-8a46c2bc7822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-964416473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49110f31-24af-48a5-8c0c-78e16529164d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221d2bc306e5401198d557f38d87a2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:01Z,use_quota=True,user_id='9af24b4d9bfd41c09cd9c416a85d93b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741e64fe-c4a5-4561-9e94-76d1f22676b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (741e64fe-c4a5-4561-9e94-76d1f22676b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9d023d-9062-4ff7-b5e3-1ff612538620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a9d023d-9062-4ff7-b5e3-1ff612538620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49110f31-24af-48a5-8c0c-78e16529164d', 'volume_name': 'volume-49110f31-24af-48a5-8c0c-78e16529164d', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3594952f-9774-45e9-9e04-b4677d75a255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3594952f-9774-45e9-9e04-b4677d75a255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fa15fe-db7f-4ea2-bcd1-527ee62fe76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:01 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Volume 49110f31-24af-48a5-8c0c-78e16529164d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49110f31-24af-48a5-8c0c-78e16529164d', 'volume_size': 1} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-964416473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49110f31-24af-48a5-8c0c-78e16529164d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='221d2bc306e5401198d557f38d87a2d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:01Z,use_quota=True,user_id='9af24b4d9bfd41c09cd9c416a85d93b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Creating volume 49110f31-24af-48a5-8c0c-78e16529164d {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:01 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:01 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d 1073741824 Jun 19 04:18:01 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:01 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.896s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:01 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Deleted volume successfully. Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0631a0a2-5bd8-48ae-9019-deb4c7d1cefa tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-6db56c1e-9070-4671-9d0c-a86e238d927b-delete_volume" released by "delete_volume" :: held 3.111s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:01 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc" returned: 0 in 0.910s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:01 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc Jun 19 04:18:01 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:02 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d 1073741824" returned: 0 in 0.965s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:02 devstack sudo[100791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d Jun 19 04:18:02 devstack sudo[100791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:02 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a74bd64d-2fe4-43bb-a299-483f82cfabbc" returned: 0 in 0.735s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-quobyte-a74bd64d-2fe4-43bb-a299-483f82cfabbc" released by "delete_volume" :: held 1.710s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d9fc11eb-149d-4baf-a63e-6416ff4995ce tempest-GroupsV314Test-213304475 None] Group tempest-GroupsV314Test-Group-1927671791: creating Jun 19 04:18:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d9fc11eb-149d-4baf-a63e-6416ff4995ce tempest-GroupsV314Test-213304475 None] Group tempest-GroupsV314Test-Group-1927671791: created successfully Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Created reservations ['c1fe30ec-bfec-4690-b94c-43a0fd7cab3f', 'f4a09c27-accd-47e3-a805-c157444c8e91', '64cef5ff-798a-4027-be29-290d3623c710', 'ed628d04-b45a-4fd0-a0f6-19a28714cb9c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d9fc11eb-149d-4baf-a63e-6416ff4995ce tempest-GroupsV314Test-213304475 None] Create group completed successfully. Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:02 devstack sudo[100794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:02 devstack sudo[100794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:02 devstack sudo[100791]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d" returned: 0 in 0.694s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3fa15fe-db7f-4ea2-bcd1-527ee62fe76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49110f31-24af-48a5-8c0c-78e16529164d', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45007904-866f-4623-841e-667ab934db82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:02 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Volume volume-49110f31-24af-48a5-8c0c-78e16529164d (49110f31-24af-48a5-8c0c-78e16529164d): created successfully Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45007904-866f-4623-841e-667ab934db82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Flow 'volume_create_manager' (01101595-d919-4734-a9cb-7dd8907b714b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6bd4105d-5ce0-47b5-a640-38120bb610b6 tempest-VolumesTransfersV355Test-1624921708 None] Created volume successfully. Jun 19 04:18:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "cinder-49dc96d0-8d8b-4be9-941f-3c877cbdcab5-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-49dc96d0-8d8b-4be9-941f-3c877cbdcab5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "cinder-quobyte-49dc96d0-8d8b-4be9-941f-3c877cbdcab5" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-quobyte-49dc96d0-8d8b-4be9-941f-3c877cbdcab5" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc4c86d-10cc-4490-8b19-5c5f900a3ae1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:03 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 Jun 19 04:18:03 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:03 devstack sudo[100794]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.768s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:03 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Deleted volume successfully. Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-74eaa402-379c-41dc-8173-e32f0f5c25c7 tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-a74bd64d-2fe4-43bb-a299-483f82cfabbc-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Acquiring lock "cinder-49110f31-24af-48a5-8c0c-78e16529164d-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Lock "cinder-49110f31-24af-48a5-8c0c-78e16529164d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Acquiring lock "cinder-quobyte-49110f31-24af-48a5-8c0c-78e16529164d" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Lock "cinder-quobyte-49110f31-24af-48a5-8c0c-78e16529164d" acquired by "delete_volume" :: waited 0.026s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bb7124-e666-4f23-a93c-8e9f0fb4428a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:03 devstack sudo[100800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d Jun 19 04:18:03 devstack sudo[100800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:03 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5" returned: 0 in 0.877s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:04 devstack sudo[100805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5 Jun 19 04:18:04 devstack sudo[100805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Flow 'volume_create_manager' (cd20e585-b0ac-4c2c-b8a8-4792142ae5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60876632-fbcc-43ae-8e58-fbb19b01a983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60876632-fbcc-43ae-8e58-fbb19b01a983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476316130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=603ec8bf-12a3-4e15-a141-43907645f398,host='devstack@QuobyteHD#QuobyteHD',id=f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a5ad16c920486d97c0a671b4d015b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:04Z,use_quota=True,user_id='424aaad7e2524c328b0aef43b45c0e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12ab3030-ff82-48fe-8422-dff05e456249),volume_type_id=12ab3030-ff82-48fe-8422-dff05e456249)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1ff6c6-f2fa-4630-9ee5-ccb173f06145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f1ff6c6-f2fa-4630-9ee5-ccb173f06145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd8ec18-bd77-4921-a792-c157fda441d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd8ec18-bd77-4921-a792-c157fda441d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e', 'volume_name': 'volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f749272c-f3b6-4d64-ab44-cf220ae83a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f749272c-f3b6-4d64-ab44-cf220ae83a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bc10ab-eac9-43c7-90d6-c645ddd00cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:04 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Volume f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e', 'volume_size': 1} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=603ec8bf-12a3-4e15-a141-43907645f398,created_at=2026-06-19T02:18:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1476316130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=603ec8bf-12a3-4e15-a141-43907645f398,host='devstack@QuobyteHD#QuobyteHD',id=f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7a5ad16c920486d97c0a671b4d015b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:04Z,use_quota=True,user_id='424aaad7e2524c328b0aef43b45c0e85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(12ab3030-ff82-48fe-8422-dff05e456249),volume_type_id=12ab3030-ff82-48fe-8422-dff05e456249)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Creating volume f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:04 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:04 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e 1073741824 Jun 19 04:18:04 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:04 devstack sudo[100800]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d" returned: 0 in 0.904s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:04 devstack sudo[100812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d Jun 19 04:18:04 devstack sudo[100812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:04 devstack sudo[100805]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49dc96d0-8d8b-4be9-941f-3c877cbdcab5" returned: 0 in 0.737s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-quobyte-49dc96d0-8d8b-4be9-941f-3c877cbdcab5" released by "delete_volume" :: held 1.664s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Created reservations ['0c8dbcbd-1656-4062-ae9c-7edccc526e62', '3179be0b-d34d-4a6d-a787-2223287afddf', '5d9ecfa3-ccce-47c1-86c6-88d544ea0a2f', '972b0329-9b36-4331-992c-02eb7c424f0c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:04 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:04 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:05 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e 1073741824" returned: 0 in 0.898s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:05 devstack sudo[100812]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49110f31-24af-48a5-8c0c-78e16529164d" returned: 0 in 0.741s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Lock "cinder-quobyte-49110f31-24af-48a5-8c0c-78e16529164d" released by "delete_volume" :: held 1.731s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:05 devstack sudo[100821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e Jun 19 04:18:05 devstack sudo[100821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Created reservations ['790c04c0-c251-4bd1-b011-effe3c6ae562', '52cfbeb2-1113-4c05-b2ee-0d88c7225666', 'bf188f3e-528d-4cba-bcc7-cf3b96f30a72', '63d58d9e-2673-45d5-a8ab-7a2480580e03'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:05 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:05 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:05 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.976s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:05 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Deleted volume successfully. Jun 19 04:18:05 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46005e0e-274b-4807-8548-3721c8da33c1 tempest-AttachVolumeTestJSON-2068967469 None] Lock "cinder-49dc96d0-8d8b-4be9-941f-3c877cbdcab5-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:06 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.885s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:06 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Deleted volume successfully. Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dbc74e86-d141-4e8e-a771-00c98660d6e1 tempest-VolumesTransfersV355Test-1555841835 None] Lock "cinder-49110f31-24af-48a5-8c0c-78e16529164d-delete_volume" released by "delete_volume" :: held 2.928s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:06 devstack sudo[100821]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" returned: 0 in 1.189s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] <== create_volume: return (2146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54bc10ab-eac9-43c7-90d6-c645ddd00cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c524b7ee-9e6b-4b38-aae4-d74ea507cc8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:06 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Volume volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e (f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e): created successfully Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c524b7ee-9e6b-4b38-aae4-d74ea507cc8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Flow 'volume_create_manager' (cd20e585-b0ac-4c2c-b8a8-4792142ae5d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:06 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b95a6ed7-7044-4b76-9c47-5743b54a5bf8 tempest-GroupsV314Test-213304475 None] Created volume successfully. Jun 19 04:18:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:08 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Cloning volume f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e to volume 5c68eb25-06e9-493e-a7cd-717131fb1115 Jun 19 04:18:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Creating offline snapshot b9ffe59e-7163-4ee1-a56d-ac4798550b99 of volume f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:18:08 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b508c6b5-66cb-4840-9229-849f2668f56e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:08 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e Jun 19 04:18:08 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:09 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" returned: 0 in 0.973s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:09 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 1G Jun 19 04:18:09 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:10 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 1G" returned: 0 in 1.107s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:10 devstack sudo[100875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 Jun 19 04:18:10 devstack sudo[100875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:11 devstack sudo[100875]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99" returned: 0 in 0.967s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:11 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:18:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:11 devstack sudo[100884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 Jun 19 04:18:11 devstack sudo[100884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:12 devstack sudo[100884]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99" returned: 0 in 0.939s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:12 devstack sudo[100891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.info Jun 19 04:18:12 devstack sudo[100891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:12 devstack sudo[100891]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.info" returned: 0 in 0.781s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:12 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:18:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:12 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.info Jun 19 04:18:12 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:13 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.info" returned: 0 in 0.678s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Acquiring lock "cinder-quobyte-5c68eb25-06e9-493e-a7cd-717131fb1115" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Lock "cinder-quobyte-5c68eb25-06e9-493e-a7cd-717131fb1115" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] snapshot: b9ffe59e-7163-4ee1-a56d-ac4798550b99, volume: 5c68eb25-06e9-493e-a7cd-717131fb1115, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e7cae4-e408-4db0-9eb5-e929cc8cf5f8]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:13 devstack sudo[100897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 Jun 19 04:18:13 devstack sudo[100897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:14 devstack sudo[100897]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99" returned: 0 in 0.944s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:18:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:18:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:18:14 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[99bc4e0c-8689-4498-afcf-8c330e3b024b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:14 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e Jun 19 04:18:14 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Flow 'volume_create_manager' (3a2a75b5-a290-445f-8a23-45c3f02cfe42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab5dea2-6b70-4088-8182-ef4dda7bf000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab5dea2-6b70-4088-8182-ef4dda7bf000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2724855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113ed913-8da5-4c75-84d9-e78009c1f21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a0731560fa45eb8192e53e18224323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:15Z,use_quota=True,user_id='5f1300cb8a1247458078ea1c8ee01770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4774cfa0-2c30-46fb-8565-58d0d84dc1a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4774cfa0-2c30-46fb-8565-58d0d84dc1a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d950b32d-1e8e-4f0f-83b9-55424dddcf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.image.glance [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Creating Keystone auth plugin from conf {{(pid=93769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-fb031028-23d3-4566-bb5a-6cea8b0a66a0 req-0a927ed9-8597-4bd4-a037-52633bf78f9a tempest-ServerActionsTestOtherA-2120436923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d950b32d-1e8e-4f0f-83b9-55424dddcf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '113ed913-8da5-4c75-84d9-e78009c1f21f', 'volume_name': 'volume-113ed913-8da5-4c75-84d9-e78009c1f21f', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19466031-1fca-4d5a-abb6-c4479e99e16d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19466031-1fca-4d5a-abb6-c4479e99e16d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5edf76-8433-4bd7-bfa4-654755a87772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:15 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Volume 113ed913-8da5-4c75-84d9-e78009c1f21f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-113ed913-8da5-4c75-84d9-e78009c1f21f', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Trying to clone 113ed913-8da5-4c75-84d9-e78009c1f21f from image f472f64e-f7ec-4170-b06c-8de073bddf2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]). {{(pid=93769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:18:15 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" returned: 0 in 0.974s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:15 devstack sudo[100916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 Jun 19 04:18:15 devstack sudo[100916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:18:15 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2fb3964-5d60-4596-bcfb-cbe6973126d9]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:16 devstack sudo[100919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD Jun 19 04:18:16 devstack sudo[100919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:17 devstack sudo[100919]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD" returned: 0 in 1.219s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:17 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Temporary image f472f64e-f7ec-4170-b06c-8de073bddf2f is fetched for user 5f1300cb8a1247458078ea1c8ee01770. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:18:17 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=118,cinder:UPDATE=125,cinder:INSERT=35,cinder:DELETE=10 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:18:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b58299-625f-473d-8fa6-7db4f1411f3a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:17 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD Jun 19 04:18:17 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:18 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD" returned: 0 in 1.442s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:21 devstack sudo[100916]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115" returned: 0 in 5.854s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea62218-110e-460c-b308-2a54b1febc11]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:21 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e Jun 19 04:18:21 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:22 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" returned: 0 in 1.121s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:22 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e, size 1024.00 MB, duration 5.85 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:18:22 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Converted 1024.00 MB image at 174.90 MB/s Jun 19 04:18:22 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:18:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:22 devstack sudo[100960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 Jun 19 04:18:22 devstack sudo[100960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:23 devstack sudo[100960]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115" returned: 0 in 0.656s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Lock "cinder-quobyte-5c68eb25-06e9-493e-a7cd-717131fb1115" released by "_copy_volume_from_snapshot" :: held 9.653s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:23 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=130,cinder:UPDATE=128,cinder:INSERT=39,cinder:DELETE=8 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:18:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Acquiring lock "cinder-quobyte-b9ffe59e-7163-4ee1-a56d-ac4798550b99" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Lock "cinder-quobyte-b9ffe59e-7163-4ee1-a56d-ac4798550b99" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Deleting offline snapshot b9ffe59e-7163-4ee1-a56d-ac4798550b99 of volume f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:18:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] snapshot_file for this snap is: volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:18:23 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96a0f82-eee6-43bc-b59b-bcc4a3b147a4]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:23 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 Jun 19 04:18:23 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:24 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99" returned: 0 in 0.860s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:18:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b9d0a8-8214-4f63-b6d2-81169e6d64ae]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:24 devstack sudo[100982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e Jun 19 04:18:24 devstack sudo[100982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:25 devstack sudo[100982]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" returned: 0 in 0.912s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:25 devstack sudo[100988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 Jun 19 04:18:25 devstack sudo[100988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:26 devstack sudo[100988]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99" returned: 0 in 0.852s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:26 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99 Jun 19 04:18:26 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:26 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e.b9ffe59e-7163-4ee1-a56d-ac4798550b99" returned: 0 in 0.746s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Lock "cinder-quobyte-b9ffe59e-7163-4ee1-a56d-ac4798550b99" released by "_delete_snapshot" :: held 3.483s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.809s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-fb031028-23d3-4566-bb5a-6cea8b0a66a0 req-0a927ed9-8597-4bd4-a037-52633bf78f9a tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.650s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:26 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef81dd15-38ea-4a6c-a97f-7adb05a278b1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-fb031028-23d3-4566-bb5a-6cea8b0a66a0 req-0a927ed9-8597-4bd4-a037-52633bf78f9a tempest-ServerActionsTestOtherA-2120436923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:26 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-89043df9-0929-44ad-bfe3-ba413a5c3fde tempest-GroupsV314Test-213304475 None] Create group from source-group-603ec8bf-12a3-4e15-a141-43907645f398 completed successfully. Jun 19 04:18:26 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 Jun 19 04:18:26 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:27 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-fb031028-23d3-4566-bb5a-6cea8b0a66a0 req-0a927ed9-8597-4bd4-a037-52633bf78f9a tempest-ServerActionsTestOtherA-2120436923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57" returned: 0 in 0.908s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-fb031028-23d3-4566-bb5a-6cea8b0a66a0 req-0a927ed9-8597-4bd4-a037-52633bf78f9a tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.972s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2724855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=113ed913-8da5-4c75-84d9-e78009c1f21f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a0731560fa45eb8192e53e18224323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:15Z,use_quota=True,user_id='5f1300cb8a1247458078ea1c8ee01770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Creating volume 113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:27 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:27 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f 1073741824 Jun 19 04:18:27 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Acquiring lock "cinder-quobyte-5c68eb25-06e9-493e-a7cd-717131fb1115" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-fb031028-23d3-4566-bb5a-6cea8b0a66a0 req-0a927ed9-8597-4bd4-a037-52633bf78f9a tempest-ServerActionsTestOtherA-2120436923 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-21730874-f9a1-491b-8e35-7e0c4c2eef57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e909a39c-16a4-4bda-ac9e-1ced60aaf6c2', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Lock "cinder-quobyte-5c68eb25-06e9-493e-a7cd-717131fb1115" acquired by "delete_volume" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a101ce31-e5f2-429d-9a52-8bef47f3c27d]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-fb031028-23d3-4566-bb5a-6cea8b0a66a0 req-0a927ed9-8597-4bd4-a037-52633bf78f9a tempest-ServerActionsTestOtherA-2120436923 None] attachment_update completed successfully. Jun 19 04:18:28 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 Jun 19 04:18:28 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:28 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115" returned: 0 in 0.974s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:28 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115 Jun 19 04:18:28 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:29 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f 1073741824" returned: 0 in 1.229s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:29 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f Jun 19 04:18:29 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:29 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5c68eb25-06e9-493e-a7cd-717131fb1115" returned: 0 in 0.719s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Lock "cinder-quobyte-5c68eb25-06e9-493e-a7cd-717131fb1115" released by "delete_volume" :: held 1.789s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Created reservations ['5b73851f-26f7-441e-ab02-4795091df6a7'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:29 devstack cinder-volume[93769]: WARNING cinder.quota [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-172540315 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-172540315, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:18:29 devstack cinder-volume[93769]: WARNING cinder.quota [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-172540315 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-172540315, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Created reservations ['dc55866b-47bd-4652-927a-a0fa7ebef300', 'ea321acd-b409-443a-8403-910e504bb0b2', '78f9572c-4bf3-47b0-b358-b47c5f9c0d93', '4816b2aa-a37f-4ee9-b0dd-c6c721888fb8'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:29 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f" returned: 0 in 0.828s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.113s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Attempting download of f472f64e-f7ec-4170-b06c-8de073bddf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}])) to volume 113ed913-8da5-4c75-84d9-e78009c1f21f. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4bfab2-faac-4b60-b587-fa7b67829fd4]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_yhm2p92v {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:30 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:30 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:30 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_yhm2p92v Jun 19 04:18:30 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:30 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.788s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:30 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7a886709-d2a3-4c94-8bcb-28358cca5bd6 tempest-GroupsV314Test-213304475 None] Delete group completed successfully. Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Acquiring lock "cinder-quobyte-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Lock "cinder-quobyte-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" acquired by "delete_volume" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4373481-0215-497c-a222-d01df29076ee]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:30 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_yhm2p92v" returned: 0 in 0.955s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_yhm2p92v {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:31 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e Jun 19 04:18:31 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:31 devstack sudo[101428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_yhm2p92v Jun 19 04:18:31 devstack sudo[101428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:31 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" returned: 0 in 0.814s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:31 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e Jun 19 04:18:31 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:31 devstack sudo[101428]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_yhm2p92v" returned: 1 in 0.793s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_yhm2p92v' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:18:31 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[992244d8-c8ad-4c15-8b92-0d7f477e36e6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:31 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD Jun 19 04:18:31 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:32 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD" returned: 0 in 0.773s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] f472f64e-f7ec-4170-b06c-8de073bddf2f was qcow2, converting to raw {{(pid=93769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:32 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" returned: 0 in 0.844s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:32 devstack sudo[101444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f Jun 19 04:18:32 devstack sudo[101444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Lock "cinder-quobyte-f9ae26aa-1a99-40b0-b3d7-d9d1341f3b5e" released by "delete_volume" :: held 1.745s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Created reservations ['4a27534a-8497-4b1e-8fa8-1b7fb2ff7b89'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Created reservations ['a7bc0127-6061-4ec2-bc1b-54397bf07b94', '2c75a23e-c35f-4f61-8dcf-d78a2eade252', '2f06549f-5748-419a-98b1-a3d0d87a43b8', '9c0024d4-2f58-4ec7-84bf-1d6c7bb9ecd8'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:32 devstack sudo[101449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:32 devstack sudo[101449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:34 devstack sudo[101449]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.232s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:34 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:34 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-2714908a-81a7-4ff6-a172-1090b1e7c424 tempest-GroupsV314Test-213304475 None] Delete group completed successfully. Jun 19 04:18:35 devstack sudo[101444]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f" returned: 0 in 2.753s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:35 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_jdj_60z9devstack@QuobyteHD, size 112.00 MB, duration 2.75 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:18:35 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Converted 112.00 MB image at 40.66 MB/s Jun 19 04:18:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:35 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f 1G Jun 19 04:18:35 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:36 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f 1G" returned: 0 in 0.816s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:36 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[66f318fe-af38-4a32-ab37-fcb89ee1eb06]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:36 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f Jun 19 04:18:36 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:37 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f" returned: 0 in 1.196s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-0a2a44a0-98fa-45e5-a705-d94a8f567200 req-9960bfd5-95c8-4a8f-b5a4-e7b6af5d9b3c tempest-ServerActionsTestOtherA-2120436923 None] Terminate volume connection completed successfully. Jun 19 04:18:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-0a2a44a0-98fa-45e5-a705-d94a8f567200 req-9960bfd5-95c8-4a8f-b5a4-e7b6af5d9b3c tempest-ServerActionsTestOtherA-2120436923 None] Deleting attachment e909a39c-16a4-4bda-ac9e-1ced60aaf6c2. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:18:37 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f Jun 19 04:18:37 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:38 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f" returned: 1 in 0.840s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Downloaded image f472f64e-f7ec-4170-b06c-8de073bddf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}])) to volume 113ed913-8da5-4c75-84d9-e78009c1f21f successfully. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Temporary image f472f64e-f7ec-4170-b06c-8de073bddf2f for user 5f1300cb8a1247458078ea1c8ee01770 is deleted. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Marking volume 113ed913-8da5-4c75-84d9-e78009c1f21f as bootable. {{(pid=93769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Copying metadata from image f472f64e-f7ec-4170-b06c-8de073bddf2f to 113ed913-8da5-4c75-84d9-e78009c1f21f. {{(pid=93769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Creating volume glance metadata for volume 113ed913-8da5-4c75-84d9-e78009c1f21f backed by image f472f64e-f7ec-4170-b06c-8de073bddf2f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc5edf76-8433-4bd7-bfa4-654755a87772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-113ed913-8da5-4c75-84d9-e78009c1f21f', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5327d4-3225-4fcd-89be-8e710b685109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:38 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Volume volume-113ed913-8da5-4c75-84d9-e78009c1f21f (113ed913-8da5-4c75-84d9-e78009c1f21f): created successfully Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a5327d4-3225-4fcd-89be-8e710b685109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Flow 'volume_create_manager' (3a2a75b5-a290-445f-8a23-45c3f02cfe42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-77d0eefa-3217-4fe2-928e-7c16dc89c8ab tempest-VolumesExtendTest-56184382 None] Created volume successfully. Jun 19 04:18:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:39 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8f735d-c127-4a7d-ba84-32c9f4d53cd6]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:40 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f Jun 19 04:18:40 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-0a2a44a0-98fa-45e5-a705-d94a8f567200 req-f72265ac-1684-40b6-8501-08b9fd51d13c tempest-ServerActionsTestOtherA-2120436923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Flow 'volume_create_manager' (e7244ad2-095a-4d7f-bc07-8266caae112e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26574ed0-ad83-443d-bc1c-327f3d92765e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26574ed0-ad83-443d-bc1c-327f3d92765e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1662505119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224b442a-f0c4-4c9a-a95e-3921072e8903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0547fb158c9b4bfd831ee858fb2fcc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:41Z,use_quota=True,user_id='227d09120c594a1bb142681caaaa36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e62b61f-2efc-4484-bb26-b2bf032c55ee),volume_type_id=1e62b61f-2efc-4484-bb26-b2bf032c55ee)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e5a8e9-39ca-4786-8b8a-8209e5bb1351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e5a8e9-39ca-4786-8b8a-8209e5bb1351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e287df0f-8372-45e5-8463-cbe5c05758f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e287df0f-8372-45e5-8463-cbe5c05758f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224b442a-f0c4-4c9a-a95e-3921072e8903', 'volume_name': 'volume-224b442a-f0c4-4c9a-a95e-3921072e8903', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e124c8bc-a06a-4463-88fb-45961a8e8bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e124c8bc-a06a-4463-88fb-45961a8e8bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a876cb5d-25e3-4bc9-9672-a76dfb1d8e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:40 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Volume 224b442a-f0c4-4c9a-a95e-3921072e8903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224b442a-f0c4-4c9a-a95e-3921072e8903', 'volume_size': 1} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:41 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f" returned: 0 in 1.112s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:41 devstack sudo[101583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f Jun 19 04:18:41 devstack sudo[101583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:41 devstack sudo[101583]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f" returned: 1 in 0.810s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f 2G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:41 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:41 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f 2G" returned: 0 in 0.060s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.060s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-0a2a44a0-98fa-45e5-a705-d94a8f567200 req-f72265ac-1684-40b6-8501-08b9fd51d13c tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.769s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[54114925-dad1-45a5-8aee-be051b947aa0]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-0a2a44a0-98fa-45e5-a705-d94a8f567200 req-f72265ac-1684-40b6-8501-08b9fd51d13c tempest-ServerActionsTestOtherA-2120436923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:42 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f50f45bb-57ac-4faa-91be-81de5626f2df tempest-VolumesExtendTest-56184382 None] Extend volume completed successfully. Jun 19 04:18:42 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 Jun 19 04:18:42 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Acquiring lock "cinder-113ed913-8da5-4c75-84d9-e78009c1f21f-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Lock "cinder-113ed913-8da5-4c75-84d9-e78009c1f21f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Acquiring lock "cinder-quobyte-113ed913-8da5-4c75-84d9-e78009c1f21f" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Lock "cinder-quobyte-113ed913-8da5-4c75-84d9-e78009c1f21f" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ebc2b4-630e-4be7-9cb5-e5f1450a1020]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:42 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f Jun 19 04:18:42 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:42 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.719s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:18:42 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-0a2a44a0-98fa-45e5-a705-d94a8f567200 req-f72265ac-1684-40b6-8501-08b9fd51d13c tempest-ServerActionsTestOtherA-2120436923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57" returned: 0 in 0.823s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-0a2a44a0-98fa-45e5-a705-d94a8f567200 req-f72265ac-1684-40b6-8501-08b9fd51d13c tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.849s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.816s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1662505119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224b442a-f0c4-4c9a-a95e-3921072e8903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0547fb158c9b4bfd831ee858fb2fcc15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:41Z,use_quota=True,user_id='227d09120c594a1bb142681caaaa36cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1e62b61f-2efc-4484-bb26-b2bf032c55ee),volume_type_id=1e62b61f-2efc-4484-bb26-b2bf032c55ee)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Creating volume 224b442a-f0c4-4c9a-a95e-3921072e8903 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:42 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:42 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903 1073741824 Jun 19 04:18:42 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-0a2a44a0-98fa-45e5-a705-d94a8f567200 req-f72265ac-1684-40b6-8501-08b9fd51d13c tempest-ServerActionsTestOtherA-2120436923 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-21730874-f9a1-491b-8e35-7e0c4c2eef57', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7a170398-e16f-4ad4-9618-acf4ab62bacf', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:18:43 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-0a2a44a0-98fa-45e5-a705-d94a8f567200 req-f72265ac-1684-40b6-8501-08b9fd51d13c tempest-ServerActionsTestOtherA-2120436923 None] attachment_update completed successfully. Jun 19 04:18:43 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f" returned: 0 in 0.877s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:43 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f Jun 19 04:18:43 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:43 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903 1073741824" returned: 0 in 1.014s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:43 devstack sudo[101613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903 Jun 19 04:18:43 devstack sudo[101613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:44 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f" returned: 1 in 0.785s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:44 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f Jun 19 04:18:44 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:44 devstack sudo[101613]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903" returned: 0 in 0.781s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a876cb5d-25e3-4bc9-9672-a76dfb1d8e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224b442a-f0c4-4c9a-a95e-3921072e8903', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac86ce9-17c6-4e15-af34-438db9a673a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:44 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Volume volume-224b442a-f0c4-4c9a-a95e-3921072e8903 (224b442a-f0c4-4c9a-a95e-3921072e8903): created successfully Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac86ce9-17c6-4e15-af34-438db9a673a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Flow 'volume_create_manager' (e7244ad2-095a-4d7f-bc07-8266caae112e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-837ffbb1-00de-44f6-a710-5df275406024 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Created volume successfully. Jun 19 04:18:44 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-113ed913-8da5-4c75-84d9-e78009c1f21f" returned: 0 in 0.712s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Lock "cinder-quobyte-113ed913-8da5-4c75-84d9-e78009c1f21f" released by "delete_volume" :: held 2.442s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Created reservations ['c4ab75b7-05b0-44d3-b10d-c5226a3bcbe2', '8710dab8-8764-4d59-9837-5b912e7e7945', 'bbba099b-a25f-4aea-ba9b-8b85d8cabf78', 'cda8055d-8251-4ccd-8033-c4b529203b11'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:44 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:44 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-79ca3ac8-57c2-4918-b089-e20ac2c11a63 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-79ca3ac8-57c2-4918-b089-e20ac2c11a63 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-79ca3ac8-57c2-4918-b089-e20ac2c11a63 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-79ca3ac8-57c2-4918-b089-e20ac2c11a63 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-79ca3ac8-57c2-4918-b089-e20ac2c11a63 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-79ca3ac8-57c2-4918-b089-e20ac2c11a63 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:45 devstack sudo[101643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:45 devstack sudo[101643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:45 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.783s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:45 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Deleted volume successfully. Jun 19 04:18:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1c35405f-9bc0-48e5-9d43-d912bdc0e91f tempest-VolumesExtendTest-56184382 None] Lock "cinder-113ed913-8da5-4c75-84d9-e78009c1f21f-delete_volume" released by "delete_volume" :: held 3.472s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Flow 'volume_create_manager' (2c8ff528-fa66-43c4-872b-3950d4a2c2ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f893c45c-67b1-4f43-af58-63fd57ba2ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:46 devstack sudo[101643]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-79ca3ac8-57c2-4918-b089-e20ac2c11a63 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.983s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-79ca3ac8-57c2-4918-b089-e20ac2c11a63 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f893c45c-67b1-4f43-af58-63fd57ba2ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1870994060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9db36f7-0291-47a6-80cb-f1f3eb903e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a0731560fa45eb8192e53e18224323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:46Z,use_quota=True,user_id='5f1300cb8a1247458078ea1c8ee01770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124ab837-6246-4eb1-99dc-5c1147353559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (124ab837-6246-4eb1-99dc-5c1147353559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13e1157-0c46-411f-adec-54ad02cca7f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c13e1157-0c46-411f-adec-54ad02cca7f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9db36f7-0291-47a6-80cb-f1f3eb903e7f', 'volume_name': 'volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b161d040-5941-45de-bdcb-e7e55b92a711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b161d040-5941-45de-bdcb-e7e55b92a711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183aa659-64c5-457f-b2de-c24fc93cbfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:46 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Volume d9db36f7-0291-47a6-80cb-f1f3eb903e7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f', 'volume_size': 1} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:18:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1870994060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9db36f7-0291-47a6-80cb-f1f3eb903e7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5a0731560fa45eb8192e53e18224323',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:18:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:18:46Z,use_quota=True,user_id='5f1300cb8a1247458078ea1c8ee01770',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Creating volume d9db36f7-0291-47a6-80cb-f1f3eb903e7f {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:18:46 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:18:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-79ca3ac8-57c2-4918-b089-e20ac2c11a63 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Retype volume completed successfully. Jun 19 04:18:46 devstack sudo[101742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f 1073741824 Jun 19 04:18:46 devstack sudo[101742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Acquiring lock "cinder-224b442a-f0c4-4c9a-a95e-3921072e8903-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "cinder-224b442a-f0c4-4c9a-a95e-3921072e8903-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Acquiring lock "cinder-quobyte-224b442a-f0c4-4c9a-a95e-3921072e8903" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:18:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "cinder-quobyte-224b442a-f0c4-4c9a-a95e-3921072e8903" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:18:47 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f9585d4-9247-4807-b2f4-6b46d5205c50]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:47 devstack sudo[101784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903 Jun 19 04:18:47 devstack sudo[101784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:48 devstack sudo[101742]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f 1073741824" returned: 0 in 1.587s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:48 devstack sudo[101828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f Jun 19 04:18:48 devstack sudo[101828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:48 devstack sudo[101784]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903" returned: 0 in 1.186s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:48 devstack sudo[101830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903 Jun 19 04:18:48 devstack sudo[101830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:49 devstack sudo[101830]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-224b442a-f0c4-4c9a-a95e-3921072e8903" returned: 0 in 0.981s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "cinder-quobyte-224b442a-f0c4-4c9a-a95e-3921072e8903" released by "delete_volume" :: held 2.297s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:49 devstack cinder-volume[93769]: WARNING cinder.quota [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:18:49 devstack cinder-volume[93769]: WARNING cinder.quota [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Created reservations ['0e8ab1ad-422b-4e73-86b0-a72340177348', '7da08230-fb4e-4c54-af5f-58cc909e2ef7', 'f6fead35-5020-40be-b157-dfb32ed3cf6a', 'a7ba6a58-429b-4eff-9161-8f7eb178f522'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:18:49 devstack sudo[101828]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" returned: 0 in 1.241s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] <== create_volume: return (2899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.901s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183aa659-64c5-457f-b2de-c24fc93cbfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0364fce2-75a6-4839-9bc8-89416aa2c03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:18:49 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Volume volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f (d9db36f7-0291-47a6-80cb-f1f3eb903e7f): created successfully Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0364fce2-75a6-4839-9bc8-89416aa2c03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Flow 'volume_create_manager' (2c8ff528-fa66-43c4-872b-3950d4a2c2ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:18:49 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-0a76c903-55d5-4450-9e7b-78727d7377c3 tempest-VolumesExtendTest-56184382 None] Created volume successfully. Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:49 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:18:49 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:51 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.481s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:51 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:18:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Deleted volume successfully. Jun 19 04:18:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2bfc8cea-4d3c-4301-b223-636b97cf2183 tempest-VolumeRetypeWithoutMigrationTest-1526008004 None] Lock "cinder-224b442a-f0c4-4c9a-a95e-3921072e8903-delete_volume" released by "delete_volume" :: held 4.307s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:18:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:18:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:18:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Creating offline snapshot 4ae822b8-bdeb-486e-8f03-16020fae705c of volume d9db36f7-0291-47a6-80cb-f1f3eb903e7f {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:18:51 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5bd32a-2f21-416f-85dd-917b9747f8b1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:18:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:51 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f Jun 19 04:18:51 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:53 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" returned: 0 in 1.950s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:53 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c 1G Jun 19 04:18:53 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:55 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c 1G" returned: 0 in 1.683s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:55 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c Jun 19 04:18:55 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:56 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c" returned: 0 in 1.410s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:56 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c is being set with open permissions: ugo+rw Jun 19 04:18:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:56 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c Jun 19 04:18:56 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:57 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c" returned: 0 in 0.802s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:57 devstack sudo[102237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.info Jun 19 04:18:57 devstack sudo[102237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:58 devstack sudo[102237]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.info" returned: 0 in 0.793s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:58 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.info is being set with open permissions: ugo+rw Jun 19 04:18:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:18:58 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.info Jun 19 04:18:58 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:18:59 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jun 19 04:18:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.info" returned: 0 in 0.985s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:18:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.797s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:18:59 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-84c55451-2c89-4ff0-95d5-54c259feda1a tempest-VolumesExtendTest-56184382 None] Create snapshot completed successfully Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Flow 'volume_create_manager' (e9c72db5-e640-4b10-8cf8-7793fa1d57e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93c3327-e8bf-4597-ba8f-ef6adc3492f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f93c3327-e8bf-4597-ba8f-ef6adc3492f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1332449879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7744be33-b5b7-448b-8709-b4f698d47be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e4f780f17148889fa0fc5ecb335f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:00Z,use_quota=True,user_id='62b965adaec1403dace5848ebbc8cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7597d9-d064-4968-8981-3a89e56e7672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7597d9-d064-4968-8981-3a89e56e7672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdeabb1-919d-4d16-b915-d3f8d986b2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdeabb1-919d-4d16-b915-d3f8d986b2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7744be33-b5b7-448b-8709-b4f698d47be3', 'volume_name': 'volume-7744be33-b5b7-448b-8709-b4f698d47be3', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c44093-cbae-409a-8e96-633004376801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34c44093-cbae-409a-8e96-633004376801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed097469-eef4-4f92-826c-7a2ece70ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:00 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Volume 7744be33-b5b7-448b-8709-b4f698d47be3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7744be33-b5b7-448b-8709-b4f698d47be3', 'volume_size': 1} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1332449879',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7744be33-b5b7-448b-8709-b4f698d47be3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26e4f780f17148889fa0fc5ecb335f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:00Z,use_quota=True,user_id='62b965adaec1403dace5848ebbc8cb54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Creating volume 7744be33-b5b7-448b-8709-b4f698d47be3 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:00 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:00 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3 1073741824 Jun 19 04:19:00 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d2ad67fd-be7e-46af-98ab-6ad0a12dc11b tempest-VolumesExtendTest-56184382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:01 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3 1073741824" returned: 0 in 1.027s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:01 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3 Jun 19 04:19:01 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:02 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3" returned: 0 in 0.827s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.925s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d2ad67fd-be7e-46af-98ab-6ad0a12dc11b tempest-VolumesExtendTest-56184382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.838s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed097469-eef4-4f92-826c-7a2ece70ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7744be33-b5b7-448b-8709-b4f698d47be3', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c6ec1b-47c4-4c1b-89e2-a6407a4c2aa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[369f087f-bf7a-4470-aaf4-1c55f34f3595]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d2ad67fd-be7e-46af-98ab-6ad0a12dc11b tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:02 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Volume volume-7744be33-b5b7-448b-8709-b4f698d47be3 (7744be33-b5b7-448b-8709-b4f698d47be3): created successfully Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61c6ec1b-47c4-4c1b-89e2-a6407a4c2aa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Flow 'volume_create_manager' (e9c72db5-e640-4b10-8cf8-7793fa1d57e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-be548ad2-797c-4af5-b49e-aa0a5502453b tempest-VolumesServicesTestJSON-1189041944 None] Created volume successfully. Jun 19 04:19:02 devstack sudo[102269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f Jun 19 04:19:02 devstack sudo[102269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:02 devstack sudo[102269]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d2ad67fd-be7e-46af-98ab-6ad0a12dc11b tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" returned: 0 in 0.810s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d2ad67fd-be7e-46af-98ab-6ad0a12dc11b tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c 2G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d2ad67fd-be7e-46af-98ab-6ad0a12dc11b tempest-VolumesExtendTest-56184382 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c 2G" returned: 0 in 0.134s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d2ad67fd-be7e-46af-98ab-6ad0a12dc11b tempest-VolumesExtendTest-56184382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.996s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:03 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d2ad67fd-be7e-46af-98ab-6ad0a12dc11b tempest-VolumesExtendTest-56184382 None] Extend volume completed successfully. Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Acquiring lock "cinder-7744be33-b5b7-448b-8709-b4f698d47be3-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Lock "cinder-7744be33-b5b7-448b-8709-b4f698d47be3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Acquiring lock "cinder-quobyte-7744be33-b5b7-448b-8709-b4f698d47be3" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Lock "cinder-quobyte-7744be33-b5b7-448b-8709-b4f698d47be3" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d8d3102-26d2-4ac1-a992-61e31b1e9b18]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:03 devstack sudo[102278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3 Jun 19 04:19:03 devstack sudo[102278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Acquiring lock "cinder-4ae822b8-bdeb-486e-8f03-16020fae705c-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Lock "cinder-4ae822b8-bdeb-486e-8f03-16020fae705c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Acquiring lock "cinder-quobyte-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Lock "cinder-quobyte-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Acquiring lock "cinder-quobyte-4ae822b8-bdeb-486e-8f03-16020fae705c" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Lock "cinder-quobyte-4ae822b8-bdeb-486e-8f03-16020fae705c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Deleting offline snapshot 4ae822b8-bdeb-486e-8f03-16020fae705c of volume d9db36f7-0291-47a6-80cb-f1f3eb903e7f {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] snapshot_file for this snap is: volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5608d4c-edbb-44a8-968f-102b5b62fe7e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:03 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c Jun 19 04:19:03 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:04 devstack sudo[102278]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3" returned: 0 in 0.857s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:04 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3 Jun 19 04:19:04 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:04 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c" returned: 0 in 0.839s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:04 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8d1aa9-43fa-4bdb-8e60-4f80c8001f6a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:04 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f Jun 19 04:19:04 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:04 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7744be33-b5b7-448b-8709-b4f698d47be3" returned: 0 in 0.643s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Lock "cinder-quobyte-7744be33-b5b7-448b-8709-b4f698d47be3" released by "delete_volume" :: held 1.549s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Created reservations ['55f9f4e8-769b-4deb-96ac-183de601bafb', 'deb31c85-73f0-4eaf-b346-2b436c3ac1d1', '0e5b9ffc-8664-4fb9-8fd4-7a62a705597f', 'b7aeb7e8-1e16-44e7-afe3-ce3668f45d64'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:05 devstack sudo[102294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:19:05 devstack sudo[102294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:05 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:05 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c Jun 19 04:19:05 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:05 devstack sudo[102294]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.851s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:05 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:05 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Deleted volume successfully. Jun 19 04:19:06 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-041341fa-07bd-401d-8c0c-4b00767cd874 tempest-VolumesServicesTestJSON-1189041944 None] Lock "cinder-7744be33-b5b7-448b-8709-b4f698d47be3-delete_volume" released by "delete_volume" :: held 2.650s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:06 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c" returned: 0 in 1.003s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:06 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c Jun 19 04:19:06 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:07 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f.4ae822b8-bdeb-486e-8f03-16020fae705c" returned: 0 in 0.673s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Lock "cinder-quobyte-4ae822b8-bdeb-486e-8f03-16020fae705c" released by "_delete_snapshot" :: held 3.426s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Lock "cinder-quobyte-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" released by "delete_snapshot" :: held 3.449s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:07 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Created reservations ['ec3fe10d-9930-4b60-a1a1-aee6514ee926', 'd3ba31cb-302b-4e2c-beb5-405acc23844e', '48217f62-f893-4289-bcd0-e0d0723bceb7', 'e2126f57-a3e7-4e8f-ad11-68436bc2efb0'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:07 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Delete snapshot completed successfully. Jun 19 04:19:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b6f236bc-a602-4184-a368-2596d9cf9990 tempest-VolumesExtendTest-56184382 None] Lock "cinder-4ae822b8-bdeb-486e-8f03-16020fae705c-delete_snapshot" released by "delete_snapshot" :: held 3.628s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:08 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Acquiring lock "cinder-d9db36f7-0291-47a6-80cb-f1f3eb903e7f-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:08 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Lock "cinder-d9db36f7-0291-47a6-80cb-f1f3eb903e7f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:08 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Acquiring lock "cinder-quobyte-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:08 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Lock "cinder-quobyte-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:08 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[96ca4ab1-af42-4a20-a244-3e2c95bd752b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:08 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f Jun 19 04:19:08 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:09 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" returned: 0 in 0.885s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:09 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f Jun 19 04:19:09 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:09 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" returned: 0 in 0.760s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Lock "cinder-quobyte-d9db36f7-0291-47a6-80cb-f1f3eb903e7f" released by "delete_volume" :: held 1.726s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Created reservations ['3d6fb345-f001-419b-bc01-4322237bde38', '5ebac827-929f-4f65-9aff-da209596bfc6', '9fa6cd5a-46ea-43d8-b409-fd3f5c4fe7ab', '95312e9c-eb2f-43e1-88fe-ddf183218f9a'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:09 devstack sudo[102411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:19:09 devstack sudo[102411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:10 devstack sudo[102411]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.763s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:10 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:10 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Deleted volume successfully. Jun 19 04:19:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45da2386-1c29-445a-b500-07c91c66174a tempest-VolumesExtendTest-56184382 None] Lock "cinder-d9db36f7-0291-47a6-80cb-f1f3eb903e7f-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Flow 'volume_create_manager' (f4b4a664-32ec-45b2-8ce1-8c6210040342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24c4e74-d5d0-4f44-90c4-8757aa502634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e24c4e74-d5d0-4f44-90c4-8757aa502634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-134484195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51794c0-a47a-4acb-b3a6-4f9912832f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b300c425877c4b89b019b904a0f5e6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:15Z,use_quota=True,user_id='95dd2431ac0448a7a169be28f7d110dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fcf0e9-4d21-4505-a475-a041d3ece7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fcf0e9-4d21-4505-a475-a041d3ece7f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c87175e-a68b-48c0-8706-f40bb9fff8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c87175e-a68b-48c0-8706-f40bb9fff8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b51794c0-a47a-4acb-b3a6-4f9912832f27', 'volume_name': 'volume-b51794c0-a47a-4acb-b3a6-4f9912832f27', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf51db1-04e8-4063-a313-e4894c1c2c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bf51db1-04e8-4063-a313-e4894c1c2c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed1eb8d-cfbf-4ff5-9b78-551d3a39de67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:14 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Volume b51794c0-a47a-4acb-b3a6-4f9912832f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b51794c0-a47a-4acb-b3a6-4f9912832f27', 'volume_size': 1} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-134484195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b51794c0-a47a-4acb-b3a6-4f9912832f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b300c425877c4b89b019b904a0f5e6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:15Z,use_quota=True,user_id='95dd2431ac0448a7a169be28f7d110dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Creating volume b51794c0-a47a-4acb-b3a6-4f9912832f27 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:14 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:19:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:14 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 1073741824 Jun 19 04:19:14 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:15 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 1073741824" returned: 0 in 1.043s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:15 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 Jun 19 04:19:15 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:16 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27" returned: 0 in 1.037s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] <== create_volume: return (2138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.142s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ed1eb8d-cfbf-4ff5-9b78-551d3a39de67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b51794c0-a47a-4acb-b3a6-4f9912832f27', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424661b0-23ca-4e00-a6a2-c999c2be8caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:17 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Volume volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 (b51794c0-a47a-4acb-b3a6-4f9912832f27): created successfully Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424661b0-23ca-4e00-a6a2-c999c2be8caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Flow 'volume_create_manager' (f4b4a664-32ec-45b2-8ce1-8c6210040342) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:17 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-641df14c-5dc1-4c2e-a7ac-d260bf8ca7b9 tempest-AttachVolumeNegativeTest-568842932 None] Created volume successfully. Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=103,cinder:SELECT=85,cinder:INSERT=19,cinder:DELETE=7 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Flow 'volume_create_manager' (d4227a8b-c108-4967-8c60-32b3e8f3cb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef08a1df-6974-4742-87bb-6efb22e7ec75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef08a1df-6974-4742-87bb-6efb22e7ec75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1086299028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5172bcce-3ac1-4701-909b-6a6387026928,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0562ec8f30a4451aeab87e5d0865b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:17Z,use_quota=True,user_id='dc67e314d7a24627a3bd7a51ea16538d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf440946-53fb-4716-8004-7dcf0e49fcc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf440946-53fb-4716-8004-7dcf0e49fcc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fb6c76-c99e-471a-a179-cdf07d48f754) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03fb6c76-c99e-471a-a179-cdf07d48f754) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5172bcce-3ac1-4701-909b-6a6387026928', 'volume_name': 'volume-5172bcce-3ac1-4701-909b-6a6387026928', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07751263-6358-4f4a-a6d7-e9ff4a80b0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07751263-6358-4f4a-a6d7-e9ff4a80b0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5584894a-ec5e-489b-ac85-b2da5229574e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:17 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Volume 5172bcce-3ac1-4701-909b-6a6387026928: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5172bcce-3ac1-4701-909b-6a6387026928', 'volume_size': 1} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1086299028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5172bcce-3ac1-4701-909b-6a6387026928,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0562ec8f30a4451aeab87e5d0865b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:17Z,use_quota=True,user_id='dc67e314d7a24627a3bd7a51ea16538d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Creating volume 5172bcce-3ac1-4701-909b-6a6387026928 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:17 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:19:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:17 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928 1073741824 Jun 19 04:19:17 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:18 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928 1073741824" returned: 0 in 1.059s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:18 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928 Jun 19 04:19:18 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:19 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-dcc54c08-76a3-4be3-aae5-737e3b6a427d req-6d5a3e5a-2033-4ce9-8096-58cf006e2e97 tempest-ServerActionsTestOtherA-2120436923 None] Terminate volume connection completed successfully. Jun 19 04:19:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-dcc54c08-76a3-4be3-aae5-737e3b6a427d req-6d5a3e5a-2033-4ce9-8096-58cf006e2e97 tempest-ServerActionsTestOtherA-2120436923 None] Deleting attachment 7a170398-e16f-4ad4-9618-acf4ab62bacf. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:19:19 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928" returned: 0 in 0.904s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] <== create_volume: return (2013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.019s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5584894a-ec5e-489b-ac85-b2da5229574e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5172bcce-3ac1-4701-909b-6a6387026928', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f02a742-735e-4fbd-a4b8-0656faa1a11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:19 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Volume volume-5172bcce-3ac1-4701-909b-6a6387026928 (5172bcce-3ac1-4701-909b-6a6387026928): created successfully Jun 19 04:19:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f02a742-735e-4fbd-a4b8-0656faa1a11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Flow 'volume_create_manager' (d4227a8b-c108-4967-8c60-32b3e8f3cb93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:19 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-0f08439e-57cd-41ed-8ce9-5c96078898d1 tempest-VolumesListTestJSON-575909420 None] Created volume successfully. Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-aae1b0d4-473b-459f-a098-82ef13c02f90 req-0a079348-d99f-45ba-a586-994d95668aab tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-aae1b0d4-473b-459f-a098-82ef13c02f90 req-0a079348-d99f-45ba-a586-994d95668aab tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c219dda-c873-4660-b089-fdd9b8490515]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-aae1b0d4-473b-459f-a098-82ef13c02f90 req-0a079348-d99f-45ba-a586-994d95668aab tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:21 devstack sudo[102459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 Jun 19 04:19:21 devstack sudo[102459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Flow 'volume_create_manager' (f4f80b7f-0479-4438-b73c-a2c6bc8e4634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7022f0a2-b85f-460b-8b85-b2e669289120) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7022f0a2-b85f-460b-8b85-b2e669289120) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-777356550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febb9fb8-3e02-46f8-bef9-1f9765a9b1e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0562ec8f30a4451aeab87e5d0865b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:21Z,use_quota=True,user_id='dc67e314d7a24627a3bd7a51ea16538d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02026402-1b1f-40de-94bf-3900e73fab31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02026402-1b1f-40de-94bf-3900e73fab31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f112630-6e41-4bff-8257-8856b27cdb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f112630-6e41-4bff-8257-8856b27cdb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'febb9fb8-3e02-46f8-bef9-1f9765a9b1e0', 'volume_name': 'volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a374136-6fb7-48ff-a3f6-93e439e6119d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a374136-6fb7-48ff-a3f6-93e439e6119d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004d5586-05a9-4829-b889-4355299af3be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:21 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Volume febb9fb8-3e02-46f8-bef9-1f9765a9b1e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0', 'volume_size': 1} Jun 19 04:19:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:22 devstack sudo[102459]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-aae1b0d4-473b-459f-a098-82ef13c02f90 req-0a079348-d99f-45ba-a586-994d95668aab tempest-AttachVolumeNegativeTest-568842932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27" returned: 0 in 0.927s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-aae1b0d4-473b-459f-a098-82ef13c02f90 req-0a079348-d99f-45ba-a586-994d95668aab tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.975s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.659s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-777356550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=febb9fb8-3e02-46f8-bef9-1f9765a9b1e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0562ec8f30a4451aeab87e5d0865b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:21Z,use_quota=True,user_id='dc67e314d7a24627a3bd7a51ea16538d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Creating volume febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:22 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:22 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 1073741824 Jun 19 04:19:22 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-aae1b0d4-473b-459f-a098-82ef13c02f90 req-0a079348-d99f-45ba-a586-994d95668aab tempest-AttachVolumeNegativeTest-568842932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-b51794c0-a47a-4acb-b3a6-4f9912832f27', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '22a9e2e0-3526-4e30-b738-24c9d41cfb60', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:19:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-aae1b0d4-473b-459f-a098-82ef13c02f90 req-0a079348-d99f-45ba-a586-994d95668aab tempest-AttachVolumeNegativeTest-568842932 None] attachment_update completed successfully. Jun 19 04:19:23 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 1073741824" returned: 0 in 1.208s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:23 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=85,cinder:SELECT=93,cinder:INSERT=30,cinder:DELETE=3 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:19:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:23 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 Jun 19 04:19:23 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:24 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0" returned: 0 in 0.831s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] <== create_volume: return (2091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.097s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (004d5586-05a9-4829-b889-4355299af3be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e6fb5c-456f-4fa3-ad97-f5550b4beb06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:24 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Volume volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 (febb9fb8-3e02-46f8-bef9-1f9765a9b1e0): created successfully Jun 19 04:19:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e6fb5c-456f-4fa3-ad97-f5550b4beb06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Flow 'volume_create_manager' (f4f80b7f-0479-4438-b73c-a2c6bc8e4634) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:24 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-df0270d5-a38b-4e34-a897-20000bc964cc tempest-VolumesListTestJSON-575909420 None] Created volume successfully. Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Flow 'volume_create_manager' (705b0c2d-b007-46b2-8b5b-5708fe8f7180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2f10d5-1b03-46db-8272-8d348f255ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea2f10d5-1b03-46db-8272-8d348f255ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-733538508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b4a182-afe5-4300-a783-701d808bf403,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0562ec8f30a4451aeab87e5d0865b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:25Z,use_quota=True,user_id='dc67e314d7a24627a3bd7a51ea16538d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2aaf55-4bf0-4837-ba56-b5541097c736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6f2aaf55-4bf0-4837-ba56-b5541097c736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f882d40-85d9-4282-97ab-7730707cef66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f882d40-85d9-4282-97ab-7730707cef66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88b4a182-afe5-4300-a783-701d808bf403', 'volume_name': 'volume-88b4a182-afe5-4300-a783-701d808bf403', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e008d4-bce9-4042-b15f-d202e5873ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53e008d4-bce9-4042-b15f-d202e5873ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee77e18-6fb1-4c58-98b1-177bcaa1f52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:25 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Volume 88b4a182-afe5-4300-a783-701d808bf403: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88b4a182-afe5-4300-a783-701d808bf403', 'volume_size': 1} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-733538508',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88b4a182-afe5-4300-a783-701d808bf403,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c0562ec8f30a4451aeab87e5d0865b90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:25Z,use_quota=True,user_id='dc67e314d7a24627a3bd7a51ea16538d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Creating volume 88b4a182-afe5-4300-a783-701d808bf403 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:25 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:19:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:25 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403 1073741824 Jun 19 04:19:25 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:26 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403 1073741824" returned: 0 in 0.926s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:26 devstack sudo[102904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403 Jun 19 04:19:26 devstack sudo[102904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Flow 'volume_create_manager' (8df28f32-de66-43bb-bd1b-0b91952966f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c27daf-1563-4e66-a06e-2d49778545b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0c27daf-1563-4e66-a06e-2d49778545b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-656845791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff31402-19ae-47e3-896d-594eb628aedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eddb0c6fe60479ab2ea556daec65222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:27Z,use_quota=True,user_id='42edad6be3d042dc88f6519ddc5ef23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9ac006-4e9b-4591-8449-233c01671a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e9ac006-4e9b-4591-8449-233c01671a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd2c786-854a-43f8-9624-9f6ba2b0df64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdd2c786-854a-43f8-9624-9f6ba2b0df64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ff31402-19ae-47e3-896d-594eb628aedd', 'volume_name': 'volume-9ff31402-19ae-47e3-896d-594eb628aedd', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c30ee2-f41c-4acc-927f-f069e0b3442c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03c30ee2-f41c-4acc-927f-f069e0b3442c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a35a9e-feb8-41b9-9825-18505ec1dd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:26 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Volume 9ff31402-19ae-47e3-896d-594eb628aedd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ff31402-19ae-47e3-896d-594eb628aedd', 'volume_size': 1} Jun 19 04:19:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:27 devstack sudo[102904]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403" returned: 0 in 0.705s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.685s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-656845791',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ff31402-19ae-47e3-896d-594eb628aedd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eddb0c6fe60479ab2ea556daec65222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:27Z,use_quota=True,user_id='42edad6be3d042dc88f6519ddc5ef23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Creating volume 9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:27 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:27 devstack sudo[102907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd 1073741824 Jun 19 04:19:27 devstack sudo[102907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee77e18-6fb1-4c58-98b1-177bcaa1f52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88b4a182-afe5-4300-a783-701d808bf403', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c94623c-e687-4e77-9b2b-9c89f33afffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:27 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Volume volume-88b4a182-afe5-4300-a783-701d808bf403 (88b4a182-afe5-4300-a783-701d808bf403): created successfully Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c94623c-e687-4e77-9b2b-9c89f33afffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Flow 'volume_create_manager' (705b0c2d-b007-46b2-8b5b-5708fe8f7180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:27 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1e75e385-b5fe-447d-b8ed-0ac766e5b95d tempest-VolumesListTestJSON-575909420 None] Created volume successfully. Jun 19 04:19:28 devstack sudo[102907]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd 1073741824" returned: 0 in 1.088s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:28 devstack sudo[102914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd Jun 19 04:19:28 devstack sudo[102914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:29 devstack sudo[102914]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd" returned: 0 in 0.975s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] <== create_volume: return (2121ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a35a9e-feb8-41b9-9825-18505ec1dd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ff31402-19ae-47e3-896d-594eb628aedd', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65251546-07a2-42d7-b8f9-2cbe4cb92fe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:29 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Volume volume-9ff31402-19ae-47e3-896d-594eb628aedd (9ff31402-19ae-47e3-896d-594eb628aedd): created successfully Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65251546-07a2-42d7-b8f9-2cbe4cb92fe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Flow 'volume_create_manager' (8df28f32-de66-43bb-bd1b-0b91952966f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:29 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f6877fd0-1b05-4464-8345-06c7ea3afdb0 tempest-VolumesDeleteCascade-46341188 None] Created volume successfully. Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Acquiring lock "cinder-21730874-f9a1-491b-8e35-7e0c4c2eef57-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Lock "cinder-21730874-f9a1-491b-8e35-7e0c4c2eef57-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Acquiring lock "cinder-quobyte-21730874-f9a1-491b-8e35-7e0c4c2eef57" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Lock "cinder-quobyte-21730874-f9a1-491b-8e35-7e0c4c2eef57" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e594f41-7a97-4761-b723-670124a558d3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:29 devstack sudo[102933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 Jun 19 04:19:29 devstack sudo[102933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "cinder-88b4a182-afe5-4300-a783-701d808bf403-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-88b4a182-afe5-4300-a783-701d808bf403-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "cinder-quobyte-88b4a182-afe5-4300-a783-701d808bf403" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-quobyte-88b4a182-afe5-4300-a783-701d808bf403" acquired by "delete_volume" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Creating offline snapshot e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 of volume 9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff146c8f-a50f-4e49-9cbb-735080a45b8b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[63528f32-e17e-4067-8b0c-1c16d48924ba]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:30 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403 Jun 19 04:19:30 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:30 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd Jun 19 04:19:30 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:30 devstack sudo[102933]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57" returned: 0 in 1.115s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:30 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57 Jun 19 04:19:30 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:31 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403" returned: 0 in 0.913s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:31 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403 Jun 19 04:19:31 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:31 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd" returned: 0 in 1.020s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:31 devstack sudo[102954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 1G Jun 19 04:19:31 devstack sudo[102954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:31 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-21730874-f9a1-491b-8e35-7e0c4c2eef57" returned: 0 in 0.855s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Lock "cinder-quobyte-21730874-f9a1-491b-8e35-7e0c4c2eef57" released by "delete_volume" :: held 2.025s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Created reservations ['9e54a41b-fc54-4d9c-9259-17cbc49e4d93', 'efbfdef2-48ef-405e-8105-d090b73bdb3a', '6bcfc5e9-21a1-40d6-a891-de99a1fc3fce', '6f0f3c91-5d92-4f61-a47b-6c0c3e87905c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:32 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:19:32 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:32 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88b4a182-afe5-4300-a783-701d808bf403" returned: 0 in 0.926s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-quobyte-88b4a182-afe5-4300-a783-701d808bf403" released by "delete_volume" :: held 1.909s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Created reservations ['71f85cd0-5944-4578-a72a-ad7a8b861072', '87111af3-04dd-426e-b317-463b89001a4e', '92d12912-c73b-4d9b-9dd3-656f6f5f3492', '120e4332-bf45-4bb9-88c7-d7d00bbbfc5c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:32 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:19:32 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:32 devstack sudo[102954]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 1G" returned: 0 in 1.249s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff31402-19ae-47e3-896d-594eb628aedd -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "cinder-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:32 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff31402-19ae-47e3-896d-594eb628aedd -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 Jun 19 04:19:32 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "cinder-quobyte-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-quobyte-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0" acquired by "delete_volume" :: waited 0.012s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[25b1746f-d43d-4575-9690-534c101c5460]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:33 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 Jun 19 04:19:33 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:33 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.156s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:33 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:33 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Deleted volume successfully. Jun 19 04:19:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b368339e-d5b2-42bb-a055-298dacad3b22 tempest-ServerActionsTestOtherA-2120436923 None] Lock "cinder-21730874-f9a1-491b-8e35-7e0c4c2eef57-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:34 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:34 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff31402-19ae-47e3-896d-594eb628aedd -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" returned: 0 in 1.290s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:34 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 is being set with open permissions: ugo+rw Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.431s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:34 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Deleted volume successfully. Jun 19 04:19:34 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 Jun 19 04:19:34 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-06d8c631-2779-41ac-a647-56bb1d626e15 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-88b4a182-afe5-4300-a783-701d808bf403-delete_volume" released by "delete_volume" :: held 3.798s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:34 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0" returned: 0 in 1.194s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:34 devstack sudo[103029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0 Jun 19 04:19:34 devstack sudo[103029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:34 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" returned: 0 in 0.762s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:34 devstack sudo[103035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.info Jun 19 04:19:34 devstack sudo[103035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:34 devstack sudo[103029]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0" returned: 0 in 0.746s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-quobyte-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0" released by "delete_volume" :: held 2.000s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:34 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Created reservations ['7d031841-5ba4-4d38-a067-2a9ae11af861', 'ba4e0753-1322-4ce3-bf8c-5412c8c5bc11', 'df5778f2-6973-48fa-bea2-7863d35eb989', '35daf6c5-fd20-4e08-9957-272ef0a24ead'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:35 devstack sudo[103037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:19:35 devstack sudo[103037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "cinder-5172bcce-3ac1-4701-909b-6a6387026928-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-5172bcce-3ac1-4701-909b-6a6387026928-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "cinder-quobyte-5172bcce-3ac1-4701-909b-6a6387026928" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-quobyte-5172bcce-3ac1-4701-909b-6a6387026928" acquired by "delete_volume" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[632d0b2f-7f8d-47ec-9dc7-8994021a8609]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:35 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928 Jun 19 04:19:35 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:35 devstack sudo[103035]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.info" returned: 0 in 0.967s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:35 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.info is being set with open permissions: ugo+rw Jun 19 04:19:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:35 devstack sudo[103043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.info Jun 19 04:19:35 devstack sudo[103043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:36 devstack sudo[103037]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.134s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:36 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Deleted volume successfully. Jun 19 04:19:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-be078653-e2e6-428c-859f-d057676b0366 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-febb9fb8-3e02-46f8-bef9-1f9765a9b1e0-delete_volume" released by "delete_volume" :: held 3.410s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:36 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928" returned: 0 in 1.042s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:36 devstack sudo[103050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928 Jun 19 04:19:36 devstack sudo[103050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:36 devstack sudo[103043]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.info" returned: 0 in 0.861s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.295s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c91d45d3-78d5-44fd-96cd-8b84619f59c4 tempest-VolumesDeleteCascade-46341188 None] Create snapshot completed successfully Jun 19 04:19:37 devstack sudo[103050]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5172bcce-3ac1-4701-909b-6a6387026928" returned: 0 in 0.796s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-quobyte-5172bcce-3ac1-4701-909b-6a6387026928" released by "delete_volume" :: held 1.894s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:37 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Created reservations ['583bbf6d-473a-406e-84b8-674633bc1ea5', '5027ccdb-18ee-4057-9e65-7aede469d469', '6fac52d9-30c4-4e93-b1da-c225b5050cfb', 'c348aa02-b66d-4439-81a8-a59a8d3355ad'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:37 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:19:37 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Creating offline snapshot beb6df8d-974b-4fd5-b7a1-f99eee2983bc of volume 9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:19:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6910b07c-5465-4dad-a100-a88228064a6a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:38 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 Jun 19 04:19:38 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:38 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.952s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:38 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Deleted volume successfully. Jun 19 04:19:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ba935e67-68f3-42a1-b042-6fc39dc05ab4 tempest-VolumesListTestJSON-575909420 None] Lock "cinder-5172bcce-3ac1-4701-909b-6a6387026928-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:39 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" returned: 0 in 1.101s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff31402-19ae-47e3-896d-594eb628aedd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:39 devstack sudo[103080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc 1G Jun 19 04:19:39 devstack sudo[103080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:40 devstack sudo[103080]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc 1G" returned: 0 in 0.960s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:40 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc Jun 19 04:19:40 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:41 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc" returned: 0 in 0.859s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:41 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc is being set with open permissions: ugo+rw Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:41 devstack sudo[103093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc Jun 19 04:19:41 devstack sudo[103093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:41 devstack sudo[103093]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc" returned: 0 in 0.755s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.852s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e1d7b686-0934-426d-8d4b-ec0766ad1d0b tempest-VolumesDeleteCascade-46341188 None] Create snapshot completed successfully Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:41 devstack sudo[103096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:19:41 devstack sudo[103096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-9ff31402-19ae-47e3-896d-594eb628aedd-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-9ff31402-19ae-47e3-896d-594eb628aedd-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Performing cascade delete. {{(pid=93769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-beb6df8d-974b-4fd5-b7a1-f99eee2983bc-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-beb6df8d-974b-4fd5-b7a1-f99eee2983bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-9ff31402-19ae-47e3-896d-594eb628aedd" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-9ff31402-19ae-47e3-896d-594eb628aedd" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-beb6df8d-974b-4fd5-b7a1-f99eee2983bc" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-beb6df8d-974b-4fd5-b7a1-f99eee2983bc" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Deleting offline snapshot beb6df8d-974b-4fd5-b7a1-f99eee2983bc of volume 9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] snapshot_file for this snap is: volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed35cf42-0c61-4888-b2f9-1fee899f1880]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:42 devstack sudo[103098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc Jun 19 04:19:42 devstack sudo[103098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:42 devstack sudo[103096]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.030s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:19:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:19:43 devstack sudo[103098]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc" returned: 0 in 0.951s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff31402-19ae-47e3-896d-594eb628aedd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:43 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e6e51d-2a07-4c14-9c94-c65c4a7113b6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:43 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 Jun 19 04:19:43 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:44 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" returned: 0 in 0.906s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff31402-19ae-47e3-896d-594eb628aedd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:44 devstack sudo[103137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc Jun 19 04:19:44 devstack sudo[103137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:45 devstack sudo[103137]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc" returned: 0 in 0.991s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:45 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc Jun 19 04:19:45 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.beb6df8d-974b-4fd5-b7a1-f99eee2983bc" returned: 0 in 0.768s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:46 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-beb6df8d-974b-4fd5-b7a1-f99eee2983bc" released by "_delete_snapshot" :: held 3.760s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-9ff31402-19ae-47e3-896d-594eb628aedd" released by "delete_snapshot" :: held 3.798s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Created reservations ['ffd09abb-bd2a-4e5d-bf61-3e5f0a0a97bb', '138ad687-f423-47e4-a8a6-4d2b34c8c5e7', '08c7b345-cdc9-4e10-9181-a41432a5d4e5', '0b7d1250-8f9a-46fa-a71c-02a93d8a5d89'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Delete snapshot completed successfully. Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-beb6df8d-974b-4fd5-b7a1-f99eee2983bc-delete_snapshot" released by "delete_snapshot" :: held 4.076s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-9ff31402-19ae-47e3-896d-594eb628aedd" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-9ff31402-19ae-47e3-896d-594eb628aedd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Deleting offline snapshot e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 of volume 9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] snapshot_file for this snap is: volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f029a9ef-ab6e-475b-ab29-e60e4deb5602]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:46 devstack sudo[103147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 Jun 19 04:19:46 devstack sudo[103147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:47 devstack sudo[103147]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" returned: 0 in 0.931s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ff31402-19ae-47e3-896d-594eb628aedd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:19:47 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d6be5a-0bb6-43f3-915a-dfe55ee1d78e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:47 devstack sudo[103152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd Jun 19 04:19:47 devstack sudo[103152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:48 devstack sudo[103152]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd" returned: 0 in 1.086s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:48 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 Jun 19 04:19:48 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:49 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" returned: 0 in 1.010s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:49 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063 Jun 19 04:19:49 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:50 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd.e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" returned: 0 in 1.095s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063" released by "_delete_snapshot" :: held 4.326s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-9ff31402-19ae-47e3-896d-594eb628aedd" released by "delete_snapshot" :: held 4.383s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:51 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Created reservations ['10b4d7c3-ec2f-4d84-ad78-f43bfc0463b1', 'e30480ba-6bc2-4a4a-af55-52267538e898', '28c47abf-9051-4a53-a2d8-3b3f50de70ce', '1586e452-9eab-4edb-8f4b-1cf19f4f3e10'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Delete snapshot completed successfully. Jun 19 04:19:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-e8c96a6b-8974-4ee2-8a3f-ca18fcdf3063-delete_snapshot" released by "delete_snapshot" :: held 4.783s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Snapshots deleted, issuing volume delete {{(pid=93769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 19 04:19:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-9ff31402-19ae-47e3-896d-594eb628aedd" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-9ff31402-19ae-47e3-896d-594eb628aedd" acquired by "delete_volume" :: waited 0.046s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:51 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc50531f-1edc-4f6b-a02c-61286346de73]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:51 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd Jun 19 04:19:51 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:52 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd" returned: 0 in 1.503s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:52 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd Jun 19 04:19:53 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Flow 'volume_create_manager' (a3f70f88-9074-4d5a-bfa3-34c725995ef9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22632ee-94b0-47fb-9985-78987fb66e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d22632ee-94b0-47fb-9985-78987fb66e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-395942913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c5e814-ff11-47c0-adb6-ec3aa4e80d05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9aac8e01a7bc4c24b52185e777fa757c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:54Z,use_quota=True,user_id='6fb33134b25a4cfbb306e82bbb4b7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c6ada3-4d63-421e-9d5a-763a67b972dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c6ada3-4d63-421e-9d5a-763a67b972dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71889dc5-f128-448a-aa7d-647d34dcf32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71889dc5-f128-448a-aa7d-647d34dcf32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5c5e814-ff11-47c0-adb6-ec3aa4e80d05', 'volume_name': 'volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6a07f1-7270-4810-8d29-633bf2249db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c6a07f1-7270-4810-8d29-633bf2249db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4724c823-a231-4b0f-a5a4-b44927e30190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:53 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Volume b5c5e814-ff11-47c0-adb6-ec3aa4e80d05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05', 'volume_size': 1} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-395942913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5c5e814-ff11-47c0-adb6-ec3aa4e80d05,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9aac8e01a7bc4c24b52185e777fa757c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:54Z,use_quota=True,user_id='6fb33134b25a4cfbb306e82bbb4b7cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Creating volume b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:53 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:19:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:53 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 1073741824 Jun 19 04:19:53 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:54 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9ff31402-19ae-47e3-896d-594eb628aedd" returned: 0 in 1.231s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-9ff31402-19ae-47e3-896d-594eb628aedd" released by "delete_volume" :: held 2.844s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:54 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Created reservations ['2c85ddb2-36b2-4a6d-b0ec-9e457e24b950', '2e50d548-d175-4270-9b0e-61f68e7a472a', 'd4ff980a-6702-4de1-abb8-4219f17e8ce7', '8473cb4a-0650-4501-93ca-e36e12c2a7e9'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:19:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:54 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:19:54 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.973s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:55 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:19:55 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:55 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Deleted volume successfully. Jun 19 04:19:55 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3ac67626-dcc1-479d-87cd-8c0cd0a7d446 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-9ff31402-19ae-47e3-896d-594eb628aedd-delete_volume" released by "delete_volume" :: held 13.241s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:19:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 1073741824" returned: 0 in 1.748s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:55 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 Jun 19 04:19:55 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Flow 'volume_create_manager' (974481b5-1cd9-464a-99a8-4ea4f255d6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b948144-1a49-4f2b-83f5-a9ebc446db61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b948144-1a49-4f2b-83f5-a9ebc446db61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1700186042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090cf948-fba4-4a20-a56d-9e59dce6fd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eddb0c6fe60479ab2ea556daec65222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:56Z,use_quota=True,user_id='42edad6be3d042dc88f6519ddc5ef23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbc419e-ec35-4b35-83e5-7c56984e63f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdbc419e-ec35-4b35-83e5-7c56984e63f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e728709-8dd1-4a6e-a709-8812d3d56e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e728709-8dd1-4a6e-a709-8812d3d56e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090cf948-fba4-4a20-a56d-9e59dce6fd5c', 'volume_name': 'volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f4364b-bdf9-4d49-9d85-fdae93a71a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f4364b-bdf9-4d49-9d85-fdae93a71a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1de190b-a34d-4422-8d85-3948017fc21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:56 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Volume 090cf948-fba4-4a20-a56d-9e59dce6fd5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c', 'volume_size': 1} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:56 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05" returned: 0 in 1.287s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] <== create_volume: return (3146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.150s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.486s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:19:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1700186042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090cf948-fba4-4a20-a56d-9e59dce6fd5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eddb0c6fe60479ab2ea556daec65222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:19:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:19:56Z,use_quota=True,user_id='42edad6be3d042dc88f6519ddc5ef23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Creating volume 090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:19:56 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4724c823-a231-4b0f-a5a4-b44927e30190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07799a1a-a588-4dbc-b653-2df85a8dfed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:57 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Volume volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 (b5c5e814-ff11-47c0-adb6-ec3aa4e80d05): created successfully Jun 19 04:19:57 devstack sudo[103256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c 1073741824 Jun 19 04:19:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07799a1a-a588-4dbc-b653-2df85a8dfed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Flow 'volume_create_manager' (a3f70f88-9074-4d5a-bfa3-34c725995ef9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:57 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-3a85206c-11a1-4ea4-a7f2-a67902348d45 req-25f3056e-1841-4627-973d-def5806bdff2 tempest-VolumesGetTestJSON-466507032 None] Created volume successfully. Jun 19 04:19:57 devstack sudo[103256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:57 devstack sudo[103256]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c 1073741824" returned: 0 in 1.051s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:58 devstack sudo[103262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c Jun 19 04:19:58 devstack sudo[103262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Acquiring lock "cinder-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Lock "cinder-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Acquiring lock "cinder-quobyte-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Lock "cinder-quobyte-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05" acquired by "delete_volume" :: waited 0.049s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede87cb1-b193-4d03-a869-c2f18d96a648]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:19:59 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 Jun 19 04:19:59 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:19:59 devstack sudo[103262]: pam_unix(sudo:session): session closed for user root Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c" returned: 0 in 1.428s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] <== create_volume: return (2534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.542s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1de190b-a34d-4422-8d85-3948017fc21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b081b2f-df2a-46e6-8b8d-0bfbf46aaeae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:19:59 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Volume volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c (090cf948-fba4-4a20-a56d-9e59dce6fd5c): created successfully Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b081b2f-df2a-46e6-8b8d-0bfbf46aaeae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:19:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Flow 'volume_create_manager' (974481b5-1cd9-464a-99a8-4ea4f255d6b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:19:59 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-0770d503-e2c8-49e8-b539-e89fa1abf611 tempest-VolumesDeleteCascade-46341188 None] Created volume successfully. Jun 19 04:20:00 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05" returned: 0 in 0.930s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:00 devstack sudo[103271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05 Jun 19 04:20:00 devstack sudo[103271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Creating offline snapshot 1d8fde42-4cf3-4722-a833-43b9eaa992e0 of volume 090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:20:00 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae56b3ca-e161-49d0-b159-fed398adf2f2]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:00 devstack sudo[103271]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05" returned: 0 in 0.845s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Lock "cinder-quobyte-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05" released by "delete_volume" :: held 1.843s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:01 devstack sudo[103275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c Jun 19 04:20:01 devstack sudo[103275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:01 devstack cinder-volume[93769]: DEBUG cinder.quota [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Created reservations ['6d34c7d4-ba99-49f5-941b-ae5ab29d2df3', 'a1efa51f-5efe-4e1b-a5d7-e4e1edf0bc60', '80c54c34-69bd-4b21-9fcf-6d180c0f5df7', '5cc52f58-ee57-405c-81f5-b74cdee170a3'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:01 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:20:01 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:02 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.039s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:02 devstack cinder-volume[93769]: DEBUG cinder.manager [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Deleted volume successfully. Jun 19 04:20:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-e1400d30-297c-4435-920a-c5acadf0a137 req-be2ccd1e-c1a7-4fe8-9c00-29c8d36fcb94 tempest-VolumesGetTestJSON-466507032 None] Lock "cinder-b5c5e814-ff11-47c0-adb6-ec3aa4e80d05-delete_volume" released by "delete_volume" :: held 3.292s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:02 devstack sudo[103275]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c" returned: 0 in 1.446s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:02 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 1G Jun 19 04:20:02 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:03 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 1G" returned: 0 in 1.313s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:03 devstack sudo[103289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 Jun 19 04:20:03 devstack sudo[103289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:04 devstack sudo[103289]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0" returned: 0 in 0.869s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:04 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 is being set with open permissions: ugo+rw Jun 19 04:20:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:04 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 Jun 19 04:20:04 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:05 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0" returned: 0 in 0.966s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:05 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.info Jun 19 04:20:05 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:06 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.info" returned: 0 in 0.852s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:06 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.info is being set with open permissions: ugo+rw Jun 19 04:20:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:06 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.info Jun 19 04:20:06 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:07 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.info" returned: 0 in 0.683s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.272s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:07 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-517ff773-fa2e-4007-822f-306e3c00cac0 tempest-VolumesDeleteCascade-46341188 None] Create snapshot completed successfully Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Flow 'volume_create_manager' (f7b7d2ca-9a86-4094-b457-cd51116c31c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f83514-c376-44eb-bc1d-dcc7fc51ad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71f83514-c376-44eb-bc1d-dcc7fc51ad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-640434612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdfbc9d-30d9-4a19-a950-e1e0c149d84d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e21ceef932f143c5bf694b53eb396363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:07Z,use_quota=True,user_id='343150cc34e74bc6bcc1299f61498e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89f5a69-1bb8-4be9-9d5f-bd89474a665c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e89f5a69-1bb8-4be9-9d5f-bd89474a665c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3de7a2b-73c8-41cd-afb3-f60301d6a3e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3de7a2b-73c8-41cd-afb3-f60301d6a3e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bdfbc9d-30d9-4a19-a950-e1e0c149d84d', 'volume_name': 'volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f0fbc2-de7b-4d79-8f08-98b2f6d61b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f0fbc2-de7b-4d79-8f08-98b2f6d61b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbe4c18-dd5a-430e-9bdf-f6953c4955d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:07 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Volume 9bdfbc9d-30d9-4a19-a950-e1e0c149d84d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d', 'volume_size': 1} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-640434612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bdfbc9d-30d9-4a19-a950-e1e0c149d84d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e21ceef932f143c5bf694b53eb396363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:07Z,use_quota=True,user_id='343150cc34e74bc6bcc1299f61498e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Creating volume 9bdfbc9d-30d9-4a19-a950-e1e0c149d84d {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:07 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:20:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:07 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d 1073741824 Jun 19 04:20:07 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:08 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d 1073741824" returned: 0 in 1.159s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:08 devstack sudo[103363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d Jun 19 04:20:08 devstack sudo[103363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:08 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Flow 'volume_create_manager' (d3aeace2-2ab4-4945-b6a4-ae135a0215e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57d409e-a41b-4f14-aa6e-d5fb10b43240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e57d409e-a41b-4f14-aa6e-d5fb10b43240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1745734246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a5a326b-4814-4769-a4fe-beed5a587218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9eddb0c6fe60479ab2ea556daec65222',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1d8fde42-4cf3-4722-a833-43b9eaa992e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:09Z,use_quota=True,user_id='42edad6be3d042dc88f6519ddc5ef23e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3509d8-3c51-48ba-9164-463773a6f2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b3509d8-3c51-48ba-9164-463773a6f2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba5332e-9877-4431-90b2-219e95045ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ba5332e-9877-4431-90b2-219e95045ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2a5a326b-4814-4769-a4fe-beed5a587218', 'volume_name': 'volume-2a5a326b-4814-4769-a4fe-beed5a587218', 'volume_size': 1, 'snapshot_id': '1d8fde42-4cf3-4722-a833-43b9eaa992e0'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c213b77-71f4-4e15-bc04-9c0d1247a6a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c213b77-71f4-4e15-bc04-9c0d1247a6a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c8cdec-7228-46d8-acb2-17f270f9f6ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:09 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Volume 2a5a326b-4814-4769-a4fe-beed5a587218: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2a5a326b-4814-4769-a4fe-beed5a587218', 'volume_size': 1, 'snapshot_id': '1d8fde42-4cf3-4722-a833-43b9eaa992e0'} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:09 devstack sudo[103363]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d" returned: 0 in 0.796s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] <== create_volume: return (2022ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.025s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.321s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-1d8fde42-4cf3-4722-a833-43b9eaa992e0-2a5a326b-4814-4769-a4fe-beed5a587218" by "_create_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7dbe4c18-dd5a-430e-9bdf-f6953c4955d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a337e8da-ea68-463d-98e1-554145d4152b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-1d8fde42-4cf3-4722-a833-43b9eaa992e0-2a5a326b-4814-4769-a4fe-beed5a587218" acquired by "_create_volume_from_snapshot" :: waited 0.039s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Creating volume 2a5a326b-4814-4769-a4fe-beed5a587218 from snapshot 1d8fde42-4cf3-4722-a833-43b9eaa992e0 {{(pid=93769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-2a5a326b-4814-4769-a4fe-beed5a587218" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:09 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Volume volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d (9bdfbc9d-30d9-4a19-a950-e1e0c149d84d): created successfully Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a337e8da-ea68-463d-98e1-554145d4152b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Flow 'volume_create_manager' (f7b7d2ca-9a86-4094-b457-cd51116c31c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-2a5a326b-4814-4769-a4fe-beed5a587218" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] snapshot: 1d8fde42-4cf3-4722-a833-43b9eaa992e0, volume: 2a5a326b-4814-4769-a4fe-beed5a587218, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:20:09 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-72e6337d-2d9f-4d34-81fa-99f3b6d8ed0f tempest-VolumesTestJSON-533419909 None] Created volume successfully. Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8d77d64-ecc4-4fd3-a685-6660ff9ae679]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:09 devstack sudo[103366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 Jun 19 04:20:09 devstack sudo[103366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Flow 'volume_create_manager' (9e62ce2c-c9a2-4c0a-ab01-b63832596769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a99acd-3d64-4c4c-bb59-b14740248cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57a99acd-3d64-4c4c-bb59-b14740248cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1481615409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ed8022a497487c9b90ef6ac3cd4a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:10Z,use_quota=True,user_id='2dbb17e49012433aab300935e3e9febd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50845adb-ef68-407a-94db-3dd56e96449c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50845adb-ef68-407a-94db-3dd56e96449c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c473fbb-1647-4f48-870e-59567fbea956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c473fbb-1647-4f48-870e-59567fbea956) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b', 'volume_name': 'volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d341e5b-040c-4ede-af76-3548a18f50d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d341e5b-040c-4ede-af76-3548a18f50d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce7fc2d-3475-4175-a1c7-e461efec2b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Volume b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b', 'volume_size': 1} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:10 devstack sudo[103366]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0" returned: 0 in 0.781s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[52351e4f-5d9d-464a-8daa-dce138600e4a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:10 devstack sudo[103371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c Jun 19 04:20:10 devstack sudo[103371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Flow 'volume_create_manager' (86362f97-ede8-4ff1-a463-aa78aa88afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc30741-2038-4f33-90cd-94cbe4965968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc30741-2038-4f33-90cd-94cbe4965968) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-829514604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcffd7c-e321-475a-bcde-0871f80497a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ed8022a497487c9b90ef6ac3cd4a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:11Z,use_quota=True,user_id='2dbb17e49012433aab300935e3e9febd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf128d7-4d00-4f8a-9d25-d797098d6bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2cf128d7-4d00-4f8a-9d25-d797098d6bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b9cd72-ead9-46f5-a6e7-48c2ebb30528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78b9cd72-ead9-46f5-a6e7-48c2ebb30528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5dcffd7c-e321-475a-bcde-0871f80497a5', 'volume_name': 'volume-5dcffd7c-e321-475a-bcde-0871f80497a5', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7068bd5d-c5c6-44b3-8a1e-f8914e047d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7068bd5d-c5c6-44b3-8a1e-f8914e047d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6d11f9-1b63-48a2-8c0d-6e18897449d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:10 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Volume 5dcffd7c-e321-475a-bcde-0871f80497a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5dcffd7c-e321-475a-bcde-0871f80497a5', 'volume_size': 1} Jun 19 04:20:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Flow 'volume_create_manager' (a7b0a095-0a65-4480-9a34-7532cd8ac80e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b508e47-e88b-4bb2-a619-f52ff4550c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b508e47-e88b-4bb2-a619-f52ff4550c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1150352656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437a9089-39e0-421d-802a-d198f2ec09c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e21ceef932f143c5bf694b53eb396363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:11Z,use_quota=True,user_id='343150cc34e74bc6bcc1299f61498e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909f45ba-0c11-4b66-8142-538709838ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (909f45ba-0c11-4b66-8142-538709838ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73bfbd4-d66f-4a93-8572-ac1cd44edf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f73bfbd4-d66f-4a93-8572-ac1cd44edf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '437a9089-39e0-421d-802a-d198f2ec09c4', 'volume_name': 'volume-437a9089-39e0-421d-802a-d198f2ec09c4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adaf04b2-3f1d-4d35-8727-322eca7da419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adaf04b2-3f1d-4d35-8727-322eca7da419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e46732-1c96-4ee9-a70c-592852a7e59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:11 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Volume 437a9089-39e0-421d-802a-d198f2ec09c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-437a9089-39e0-421d-802a-d198f2ec09c4', 'volume_size': 1} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:11 devstack sudo[103371]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c" returned: 0 in 1.120s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:20:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:11 devstack sudo[103377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 Jun 19 04:20:11 devstack sudo[103377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:17 devstack sudo[103377]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218" returned: 0 in 5.591s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2403e5b4-df9b-402e-a28b-2b8832ba68e6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:17 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c Jun 19 04:20:17 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:18 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c" returned: 0 in 1.031s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c, size 1024.00 MB, duration 5.59 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:20:18 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Converted 1024.00 MB image at 183.12 MB/s Jun 19 04:20:18 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 is being set with open permissions: ugo+rw Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:18 devstack sudo[103416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 Jun 19 04:20:18 devstack sudo[103416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:18 devstack sudo[103416]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218" returned: 0 in 0.707s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-2a5a326b-4814-4769-a4fe-beed5a587218" released by "_copy_volume_from_snapshot" :: held 9.335s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-1d8fde42-4cf3-4722-a833-43b9eaa992e0-2a5a326b-4814-4769-a4fe-beed5a587218" released by "_create_volume_from_snapshot" :: held 9.395s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.436s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.563s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1481615409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ed8022a497487c9b90ef6ac3cd4a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:10Z,use_quota=True,user_id='2dbb17e49012433aab300935e3e9febd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Creating volume b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:18 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:18 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b 1073741824 Jun 19 04:20:18 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c8cdec-7228-46d8-acb2-17f270f9f6ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a5a326b-4814-4769-a4fe-beed5a587218', 'volume_size': 1, 'snapshot_id': '1d8fde42-4cf3-4722-a833-43b9eaa992e0'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7e2840-bb2b-4122-892d-10dd77d4ae4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=87,cinder:UPDATE=84,cinder:DELETE=10,cinder:INSERT=17 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:20:18 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Volume volume-2a5a326b-4814-4769-a4fe-beed5a587218 (2a5a326b-4814-4769-a4fe-beed5a587218): created successfully Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7e2840-bb2b-4122-892d-10dd77d4ae4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Flow 'volume_create_manager' (d3aeace2-2ab4-4945-b6a4-ae135a0215e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:19 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-026bd125-cb0e-414b-8ef8-8b6937d84925 tempest-VolumesDeleteCascade-46341188 None] Created volume successfully. Jun 19 04:20:19 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b 1073741824" returned: 0 in 1.138s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-090cf948-fba4-4a20-a56d-9e59dce6fd5c-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:20 devstack sudo[103465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b Jun 19 04:20:20 devstack sudo[103465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-090cf948-fba4-4a20-a56d-9e59dce6fd5c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Performing cascade delete. {{(pid=93769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-1d8fde42-4cf3-4722-a833-43b9eaa992e0-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-1d8fde42-4cf3-4722-a833-43b9eaa992e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-090cf948-fba4-4a20-a56d-9e59dce6fd5c" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-090cf948-fba4-4a20-a56d-9e59dce6fd5c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-1d8fde42-4cf3-4722-a833-43b9eaa992e0" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-1d8fde42-4cf3-4722-a833-43b9eaa992e0" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Deleting offline snapshot 1d8fde42-4cf3-4722-a833-43b9eaa992e0 of volume 090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] snapshot_file for this snap is: volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec18c90-2cf2-4712-a98d-25f108ee17f6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:20 devstack sudo[103468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 Jun 19 04:20:20 devstack sudo[103468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:20 devstack sudo[103465]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b" returned: 0 in 0.707s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] <== create_volume: return (1890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.893s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.022s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-829514604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcffd7c-e321-475a-bcde-0871f80497a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4ed8022a497487c9b90ef6ac3cd4a53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:11Z,use_quota=True,user_id='2dbb17e49012433aab300935e3e9febd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Creating volume 5dcffd7c-e321-475a-bcde-0871f80497a5 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:20 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:20 devstack sudo[103471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 1073741824 Jun 19 04:20:20 devstack sudo[103471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ce7fc2d-3475-4175-a1c7-e461efec2b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cc1150-d40e-4192-abad-937173a2082e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:20 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Volume volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b (b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b): created successfully Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55cc1150-d40e-4192-abad-937173a2082e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Flow 'volume_create_manager' (9e62ce2c-c9a2-4c0a-ab01-b63832596769) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:20 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7358ff51-80bc-4c0a-ab18-33857061bafb tempest-TestServerVolumeAttachmentScenario-1207937865 None] Created volume successfully. Jun 19 04:20:21 devstack sudo[103468]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0" returned: 0 in 0.981s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec02df8a-e48b-4a40-bba1-ffa776ceda69]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:21 devstack sudo[103478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c Jun 19 04:20:21 devstack sudo[103478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:21 devstack sudo[103471]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 1073741824" returned: 0 in 1.090s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:21 devstack sudo[103484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 Jun 19 04:20:21 devstack sudo[103484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:22 devstack sudo[103478]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c" returned: 0 in 0.872s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:22 devstack sudo[103489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 Jun 19 04:20:22 devstack sudo[103489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:22 devstack sudo[103484]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5" returned: 0 in 0.943s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.108s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.483s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1150352656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437a9089-39e0-421d-802a-d198f2ec09c4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e21ceef932f143c5bf694b53eb396363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:11Z,use_quota=True,user_id='343150cc34e74bc6bcc1299f61498e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Creating volume 437a9089-39e0-421d-802a-d198f2ec09c4 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:22 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6d11f9-1b63-48a2-8c0d-6e18897449d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcffd7c-e321-475a-bcde-0871f80497a5', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:22 devstack sudo[103494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4 1073741824 Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4d9aa3-bb1f-4ffc-9d7d-f639dcb81020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:22 devstack sudo[103494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:22 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Volume volume-5dcffd7c-e321-475a-bcde-0871f80497a5 (5dcffd7c-e321-475a-bcde-0871f80497a5): created successfully Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f4d9aa3-bb1f-4ffc-9d7d-f639dcb81020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Flow 'volume_create_manager' (86362f97-ede8-4ff1-a463-aa78aa88afc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-529fd539-76a8-49e2-8656-7b602b78ed68 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Created volume successfully. Jun 19 04:20:23 devstack sudo[103489]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0" returned: 0 in 1.057s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:23 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0 Jun 19 04:20:23 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:23 devstack sudo[103494]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4 1073741824" returned: 0 in 1.111s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:23 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=98,cinder:DELETE=8,cinder:SELECT=60,cinder:INSERT=24 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:24 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4 Jun 19 04:20:24 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:24 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c.1d8fde42-4cf3-4722-a833-43b9eaa992e0" returned: 0 in 0.920s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-1d8fde42-4cf3-4722-a833-43b9eaa992e0" released by "_delete_snapshot" :: held 3.975s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-090cf948-fba4-4a20-a56d-9e59dce6fd5c" released by "delete_snapshot" :: held 4.000s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Created reservations ['99ef5b09-89cd-499d-99ad-3436710d10cf', '729ac273-2755-4c1a-85d4-dde6add3e753', 'f8cd77af-6450-4f17-98ec-f1651571d690', '65a387f5-27fc-4ae3-b864-4e5330f18887'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:24 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Delete snapshot completed successfully. Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-1d8fde42-4cf3-4722-a833-43b9eaa992e0-delete_snapshot" released by "delete_snapshot" :: held 4.195s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Snapshots deleted, issuing volume delete {{(pid=93769) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-090cf948-fba4-4a20-a56d-9e59dce6fd5c" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-090cf948-fba4-4a20-a56d-9e59dce6fd5c" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[553bb07a-7168-47e9-9e0b-30ca8d9b4ceb]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:24 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c Jun 19 04:20:24 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:24 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4" returned: 0 in 0.723s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] <== create_volume: return (1895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.898s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91e46732-1c96-4ee9-a70c-592852a7e59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437a9089-39e0-421d-802a-d198f2ec09c4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade187cc-c4fc-41f2-97a8-8a039bec6b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:24 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Volume volume-437a9089-39e0-421d-802a-d198f2ec09c4 (437a9089-39e0-421d-802a-d198f2ec09c4): created successfully Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ade187cc-c4fc-41f2-97a8-8a039bec6b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Flow 'volume_create_manager' (a7b0a095-0a65-4480-9a34-7532cd8ac80e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:24 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5d780c10-2590-4d94-b245-a60c43c56fea tempest-VolumesTestJSON-533419909 None] Created volume successfully. Jun 19 04:20:25 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c" returned: 0 in 0.802s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:25 devstack sudo[103531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c Jun 19 04:20:25 devstack sudo[103531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:25 devstack sudo[103531]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-090cf948-fba4-4a20-a56d-9e59dce6fd5c" returned: 0 in 0.840s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-090cf948-fba4-4a20-a56d-9e59dce6fd5c" released by "delete_volume" :: held 1.722s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Created reservations ['92e64235-dfe4-4757-b778-a1326c43ec8b', '46f3be0f-35e7-4fcc-8cf9-9a10016bfdf2', '4cff7e07-524a-4969-bf2f-3b109e581c8a', '75c0d41f-4b8f-46c7-a7b6-3b783e174b58'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:26 devstack sudo[103534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:20:26 devstack sudo[103534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Flow 'volume_create_manager' (f00e06d6-ff27-46bf-adaf-6fb609165ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688b6140-a3fc-4702-8203-83ed001c6cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (688b6140-a3fc-4702-8203-83ed001c6cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1841275620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0901080e-2f50-4d12-a302-71581d8a23ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e21ceef932f143c5bf694b53eb396363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:26Z,use_quota=True,user_id='343150cc34e74bc6bcc1299f61498e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5183630d-e521-41ae-b25c-f5f90037c89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5183630d-e521-41ae-b25c-f5f90037c89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ade6726-457f-4f00-b057-e605f9f6594c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ade6726-457f-4f00-b057-e605f9f6594c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0901080e-2f50-4d12-a302-71581d8a23ec', 'volume_name': 'volume-0901080e-2f50-4d12-a302-71581d8a23ec', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5992df0e-148b-4558-a833-edcb60503cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5992df0e-148b-4558-a833-edcb60503cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e5196c-62c6-476d-8d67-c57ffc774a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:26 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Volume 0901080e-2f50-4d12-a302-71581d8a23ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0901080e-2f50-4d12-a302-71581d8a23ec', 'volume_size': 1} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1841275620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0901080e-2f50-4d12-a302-71581d8a23ec,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e21ceef932f143c5bf694b53eb396363',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:26Z,use_quota=True,user_id='343150cc34e74bc6bcc1299f61498e4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Creating volume 0901080e-2f50-4d12-a302-71581d8a23ec {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:26 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:26 devstack sudo[103539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec 1073741824 Jun 19 04:20:26 devstack sudo[103539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-2a5a326b-4814-4769-a4fe-beed5a587218-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-2a5a326b-4814-4769-a4fe-beed5a587218-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "cinder-quobyte-2a5a326b-4814-4769-a4fe-beed5a587218" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-2a5a326b-4814-4769-a4fe-beed5a587218" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:27 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d116c2-5eb3-4e3a-a474-48f0c2125856]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:27 devstack sudo[103534]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.993s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:27 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:27 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Deleted volume successfully. Jun 19 04:20:27 devstack sudo[103544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 Jun 19 04:20:27 devstack sudo[103544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e53d8eba-a017-46d6-9653-a2a9cad12427 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-090cf948-fba4-4a20-a56d-9e59dce6fd5c-delete_volume" released by "delete_volume" :: held 7.224s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:27 devstack sudo[103539]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec 1073741824" returned: 0 in 1.105s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:27 devstack sudo[103549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec Jun 19 04:20:27 devstack sudo[103549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:28 devstack sudo[103544]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218" returned: 0 in 0.904s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:28 devstack sudo[103554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218 Jun 19 04:20:28 devstack sudo[103554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-1e6540a4-df30-49a7-a0a8-db550c752902 req-bc70c880-0a1e-4cec-b5fa-a4c71e4af1f1 tempest-AttachVolumeNegativeTest-568842932 None] Terminate volume connection completed successfully. Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-1e6540a4-df30-49a7-a0a8-db550c752902 req-bc70c880-0a1e-4cec-b5fa-a4c71e4af1f1 tempest-AttachVolumeNegativeTest-568842932 None] Deleting attachment 22a9e2e0-3526-4e30-b738-24c9d41cfb60. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:20:28 devstack sudo[103549]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec" returned: 0 in 0.803s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00e5196c-62c6-476d-8d67-c57ffc774a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0901080e-2f50-4d12-a302-71581d8a23ec', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608d7249-fc65-4b25-aea5-bfe4ad8a4eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:28 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Volume volume-0901080e-2f50-4d12-a302-71581d8a23ec (0901080e-2f50-4d12-a302-71581d8a23ec): created successfully Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (608d7249-fc65-4b25-aea5-bfe4ad8a4eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Flow 'volume_create_manager' (f00e06d6-ff27-46bf-adaf-6fb609165ca0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-883dbc4a-2a88-4353-92b5-7e06699fc28b tempest-VolumesTestJSON-533419909 None] Created volume successfully. Jun 19 04:20:28 devstack sudo[103554]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2a5a326b-4814-4769-a4fe-beed5a587218" returned: 0 in 0.789s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-quobyte-2a5a326b-4814-4769-a4fe-beed5a587218" released by "delete_volume" :: held 1.741s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Created reservations ['3aefe978-b332-44d4-a98c-8ba2cb38faf2', 'dd984232-4a11-45b0-bb17-addca960a900', 'fa855337-37f9-4995-bcf0-5bba710ceced', '360238d2-083d-478e-aef4-83ea9cb23245'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:29 devstack sudo[103596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:20:29 devstack sudo[103596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:30 devstack sudo[103596]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.419s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:30 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:30 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Deleted volume successfully. Jun 19 04:20:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8717d814-136d-445a-b5c8-8477957a6dc2 tempest-VolumesDeleteCascade-46341188 None] Lock "cinder-2a5a326b-4814-4769-a4fe-beed5a587218-delete_volume" released by "delete_volume" :: held 3.548s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Acquiring lock "cinder-0901080e-2f50-4d12-a302-71581d8a23ec-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Lock "cinder-0901080e-2f50-4d12-a302-71581d8a23ec-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Acquiring lock "cinder-quobyte-0901080e-2f50-4d12-a302-71581d8a23ec" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Lock "cinder-quobyte-0901080e-2f50-4d12-a302-71581d8a23ec" acquired by "delete_volume" :: waited 0.033s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcca49e1-09e8-4be7-b189-216881ee0923]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:32 devstack sudo[103670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec Jun 19 04:20:32 devstack sudo[103670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:33 devstack sudo[103670]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec" returned: 0 in 1.774s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:33 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec Jun 19 04:20:33 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:35 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0901080e-2f50-4d12-a302-71581d8a23ec" returned: 0 in 1.300s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Lock "cinder-quobyte-0901080e-2f50-4d12-a302-71581d8a23ec" released by "delete_volume" :: held 3.178s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:35 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Created reservations ['4c949ca9-7973-4d1f-8ecc-d85810b1e1e6', '1e4f3273-b1e4-4bca-8fd8-98207f1efd14', '8cd271d5-5bb7-4ae7-a0a3-9f1be45c6488', '3925818f-d142-4604-8d18-8b4423808c68'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:35 devstack sudo[103716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:20:35 devstack sudo[103716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Flow 'volume_create_manager' (6edf5be1-7c70-48cc-9153-b33a69a68576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c1347b-2a40-43ae-b91c-84538d826faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11c1347b-2a40-43ae-b91c-84538d826faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-812173018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b46c1a-721a-4233-beab-4af0b5db8156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485a1cf7333543cba81ae5f1792fd291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:36Z,use_quota=True,user_id='b2f105c790734a96ad43a3aa7fd7ed8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5aa4cd2-a743-401d-a5e5-07a1cf09a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5aa4cd2-a743-401d-a5e5-07a1cf09a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3bd79e-570e-4024-aa3f-516dcc440a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e3bd79e-570e-4024-aa3f-516dcc440a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55b46c1a-721a-4233-beab-4af0b5db8156', 'volume_name': 'volume-55b46c1a-721a-4233-beab-4af0b5db8156', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95eef047-4f20-425e-956b-6c3f470e7fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95eef047-4f20-425e-956b-6c3f470e7fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0172ab-d958-4451-b0b5-9931333eb072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Volume 55b46c1a-721a-4233-beab-4af0b5db8156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55b46c1a-721a-4233-beab-4af0b5db8156', 'volume_size': 1} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-812173018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55b46c1a-721a-4233-beab-4af0b5db8156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485a1cf7333543cba81ae5f1792fd291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:36Z,use_quota=True,user_id='b2f105c790734a96ad43a3aa7fd7ed8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Creating volume 55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:36 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:36 devstack sudo[103718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 1073741824 Jun 19 04:20:36 devstack sudo[103718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:36 devstack sudo[103716]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.914s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Deleted volume successfully. Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cc5ab9a9-01d8-470c-9ba9-3cded6f5adb4 tempest-VolumesTestJSON-533419909 None] Lock "cinder-0901080e-2f50-4d12-a302-71581d8a23ec-delete_volume" released by "delete_volume" :: held 4.671s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Acquiring lock "cinder-437a9089-39e0-421d-802a-d198f2ec09c4-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Lock "cinder-437a9089-39e0-421d-802a-d198f2ec09c4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Acquiring lock "cinder-quobyte-437a9089-39e0-421d-802a-d198f2ec09c4" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Lock "cinder-quobyte-437a9089-39e0-421d-802a-d198f2ec09c4" acquired by "delete_volume" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[58a94a57-1444-45bd-b3ea-9e4be4ff6dc6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:36 devstack sudo[103722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4 Jun 19 04:20:36 devstack sudo[103722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:37 devstack sudo[103718]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 1073741824" returned: 0 in 1.210s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:37 devstack sudo[103729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 Jun 19 04:20:37 devstack sudo[103729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:37 devstack sudo[103722]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4" returned: 0 in 1.017s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:37 devstack sudo[103734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4 Jun 19 04:20:37 devstack sudo[103734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:38 devstack sudo[103729]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156" returned: 0 in 0.811s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.102s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e0172ab-d958-4451-b0b5-9931333eb072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55b46c1a-721a-4233-beab-4af0b5db8156', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acf7faa-157b-4aca-8521-cdc876abd833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:38 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Volume volume-55b46c1a-721a-4233-beab-4af0b5db8156 (55b46c1a-721a-4233-beab-4af0b5db8156): created successfully Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1acf7faa-157b-4aca-8521-cdc876abd833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Flow 'volume_create_manager' (6edf5be1-7c70-48cc-9153-b33a69a68576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9c944fdb-663e-41d7-80cf-6024ce969afb tempest-VolumesCloneTest-1925559324 None] Created volume successfully. Jun 19 04:20:38 devstack sudo[103734]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-437a9089-39e0-421d-802a-d198f2ec09c4" returned: 0 in 0.727s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Lock "cinder-quobyte-437a9089-39e0-421d-802a-d198f2ec09c4" released by "delete_volume" :: held 1.801s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Created reservations ['ae44c209-d9db-4023-b731-9173d5f79aa6', '15ccab76-9616-4b44-8c43-1f821a381ab9', '3abb98dc-c629-41bd-b845-81b93ab68f43', 'bf419273-cf62-4c66-bc67-62608392a1db'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:38 devstack sudo[103738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:20:38 devstack sudo[103738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Acquiring lock "cinder-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Lock "cinder-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Acquiring lock "cinder-quobyte-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Lock "cinder-quobyte-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d" acquired by "delete_volume" :: waited 0.043s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f30cc20-40ae-4503-a665-da2315e5de0f]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:39 devstack sudo[103740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d Jun 19 04:20:39 devstack sudo[103740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:39 devstack sudo[103738]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.892s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:39 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Deleted volume successfully. Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-35681d90-48f5-44e2-b9fa-bb86e56a18cb tempest-VolumesTestJSON-533419909 None] Lock "cinder-437a9089-39e0-421d-802a-d198f2ec09c4-delete_volume" released by "delete_volume" :: held 3.019s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Flow 'volume_create_manager' (7b3ac4ef-6a0c-4669-9e99-7ec98bf8a5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce819bef-8e69-4120-97fc-65ed6d006359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce819bef-8e69-4120-97fc-65ed6d006359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-447808855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6847cb9b-803f-4909-a029-77d112a3775d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='485a1cf7333543cba81ae5f1792fd291',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:40Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=55b46c1a-721a-4233-beab-4af0b5db8156,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:40Z,use_quota=True,user_id='b2f105c790734a96ad43a3aa7fd7ed8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cc8eb7-8912-4be1-afe1-4255798dd049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31cc8eb7-8912-4be1-afe1-4255798dd049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28ab9f2-dac9-4d37-9437-419c4569d50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d28ab9f2-dac9-4d37-9437-419c4569d50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6847cb9b-803f-4909-a029-77d112a3775d', 'volume_name': 'volume-6847cb9b-803f-4909-a029-77d112a3775d', 'volume_size': 2, 'source_volid': '55b46c1a-721a-4233-beab-4af0b5db8156', 'source_volstatus': 'available'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0c731a-3b5c-44fe-85d7-57b98a6c84c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a0c731a-3b5c-44fe-85d7-57b98a6c84c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf6a511-7d4a-4016-9f2c-42cb772f5cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:39 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Volume 6847cb9b-803f-4909-a029-77d112a3775d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6847cb9b-803f-4909-a029-77d112a3775d', 'volume_size': 2, 'source_volid': '55b46c1a-721a-4233-beab-4af0b5db8156', 'source_volstatus': 'available'} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:39 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Cloning volume 55b46c1a-721a-4233-beab-4af0b5db8156 to volume 6847cb9b-803f-4909-a029-77d112a3775d Jun 19 04:20:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Creating offline snapshot e71261e2-471f-4066-9c5b-30e920a5e73f of volume 55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:20:40 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[09577209-7c2b-4c1a-8054-a888b0b88c9f]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:40 devstack sudo[103743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 Jun 19 04:20:40 devstack sudo[103743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:40 devstack sudo[103740]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d" returned: 0 in 1.377s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:40 devstack sudo[103749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d Jun 19 04:20:40 devstack sudo[103749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:41 devstack sudo[103743]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156" returned: 0 in 1.041s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:41 devstack sudo[103756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f 1G Jun 19 04:20:41 devstack sudo[103756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:41 devstack sudo[103749]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d" returned: 0 in 0.933s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Lock "cinder-quobyte-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d" released by "delete_volume" :: held 2.380s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Created reservations ['ab4515c0-1a14-408f-a54a-aa01b4c2c124', '816a24e3-4c5e-4d76-ad65-4a10f5e1ce67', 'd735a1b5-9d3f-4874-9df8-45016cbe6bcc', '769635ef-63b8-4816-9092-a9c373e4de19'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:41 devstack sudo[103759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:20:41 devstack sudo[103759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:41 devstack sudo[103764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:20:41 devstack sudo[103764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:42 devstack sudo[103756]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f 1G" returned: 0 in 1.261s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b46c1a-721a-4233-beab-4af0b5db8156 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:42 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b46c1a-721a-4233-beab-4af0b5db8156 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f Jun 19 04:20:42 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:43 devstack sudo[103759]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.298s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:43 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Deleted volume successfully. Jun 19 04:20:43 devstack sudo[103764]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.141s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-174dd595-01a4-4b06-ab9c-3e2b74b8bbd8 tempest-VolumesTestJSON-533419909 None] Lock "cinder-9bdfbc9d-30d9-4a19-a950-e1e0c149d84d-delete_volume" released by "delete_volume" :: held 4.085s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:43 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55b46c1a-721a-4233-beab-4af0b5db8156 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f" returned: 0 in 1.295s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:43 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f is being set with open permissions: ugo+rw Jun 19 04:20:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:43 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f Jun 19 04:20:43 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:44 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f" returned: 0 in 0.835s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:44 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.info Jun 19 04:20:44 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:45 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.info" returned: 0 in 0.695s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:45 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.info is being set with open permissions: ugo+rw Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:45 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.info Jun 19 04:20:45 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:45 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.info" returned: 0 in 0.674s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Acquiring lock "cinder-quobyte-6847cb9b-803f-4909-a029-77d112a3775d" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Lock "cinder-quobyte-6847cb9b-803f-4909-a029-77d112a3775d" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] snapshot: e71261e2-471f-4066-9c5b-30e920a5e73f, volume: 6847cb9b-803f-4909-a029-77d112a3775d, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:45 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec19e5c-ba2b-4a91-b9ff-b75745a992cd]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:46 devstack sudo[103811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f Jun 19 04:20:46 devstack sudo[103811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:46 devstack sudo[103811]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f" returned: 0 in 0.771s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55b46c1a-721a-4233-beab-4af0b5db8156(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:20:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:20:46 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a086a453-79de-4940-89d2-2ad26b8aad7a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:46 devstack sudo[103816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 Jun 19 04:20:46 devstack sudo[103816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:47 devstack sudo[103816]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156" returned: 0 in 0.847s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:47 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:20:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:47 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d Jun 19 04:20:47 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:53 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=41,cinder:UPDATE=58,cinder:INSERT=15,cinder:DELETE=6 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:20:54 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d" returned: 0 in 6.788s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3841beb5-e4c5-4273-a08f-d93431d8a4d6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=39,cinder:INSERT=15,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:20:54 devstack sudo[103858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 Jun 19 04:20:54 devstack sudo[103858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Flow 'volume_create_manager' (08a0dae1-6682-48e0-9363-725f7c588eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5902e9e2-9b3b-465b-9fd4-9c89352dfcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5902e9e2-9b3b-465b-9fd4-9c89352dfcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-140297727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fec8adf-3396-42ca-8ca7-91dd3933d2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef21bc3a56f45a18ea76af4f7bc83ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:55Z,use_quota=True,user_id='c0015cf5f8454557b0246e9f05a4bfca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee13e32-2329-4df3-826f-6b7603e8f694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bee13e32-2329-4df3-826f-6b7603e8f694) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00916816-4f20-4d19-b4ca-0efa69a3be72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00916816-4f20-4d19-b4ca-0efa69a3be72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fec8adf-3396-42ca-8ca7-91dd3933d2da', 'volume_name': 'volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9734c015-bb27-425a-8d6d-843c49aaa777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9734c015-bb27-425a-8d6d-843c49aaa777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4be6460-01e2-4b3a-bd14-26406f79b164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:54 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da', 'volume_size': 1} Jun 19 04:20:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:55 devstack sudo[103858]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156" returned: 0 in 1.085s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:55 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156, size 1024.00 MB, duration 6.79 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:20:55 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Converted 1024.00 MB image at 150.80 MB/s Jun 19 04:20:55 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d is being set with open permissions: ugo+rw Jun 19 04:20:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:55 devstack sudo[103864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d Jun 19 04:20:55 devstack sudo[103864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:56 devstack sudo[103864]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d" returned: 0 in 0.652s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Lock "cinder-quobyte-6847cb9b-803f-4909-a029-77d112a3775d" released by "_copy_volume_from_snapshot" :: held 10.248s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Acquiring lock "cinder-quobyte-e71261e2-471f-4066-9c5b-30e920a5e73f" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Lock "cinder-quobyte-e71261e2-471f-4066-9c5b-30e920a5e73f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Deleting offline snapshot e71261e2-471f-4066-9c5b-30e920a5e73f of volume 55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:20:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] snapshot_file for this snap is: volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:20:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd6a5e0-cf4a-4fb6-89a4-f86fda1de4d9]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:56 devstack sudo[103867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f Jun 19 04:20:56 devstack sudo[103867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:57 devstack sudo[103867]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f" returned: 0 in 0.855s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:57 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55b46c1a-721a-4233-beab-4af0b5db8156(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:20:57 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c6fa2f-8722-4e01-8bc8-d83de8075e83]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:57 devstack sudo[103875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 Jun 19 04:20:57 devstack sudo[103875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:57 devstack sudo[103875]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156" returned: 0 in 0.841s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:58 devstack sudo[103885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f Jun 19 04:20:58 devstack sudo[103885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:58 devstack sudo[103885]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f" returned: 0 in 0.758s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:58 devstack sudo[103894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f Jun 19 04:20:58 devstack sudo[103894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:59 devstack sudo[103894]: pam_unix(sudo:session): session closed for user root Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156.e71261e2-471f-4066-9c5b-30e920a5e73f" returned: 0 in 0.637s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Lock "cinder-quobyte-e71261e2-471f-4066-9c5b-30e920a5e73f" released by "_delete_snapshot" :: held 3.200s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.472s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.518s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:20:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-140297727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fec8adf-3396-42ca-8ca7-91dd3933d2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0ef21bc3a56f45a18ea76af4f7bc83ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:20:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:20:55Z,use_quota=True,user_id='c0015cf5f8454557b0246e9f05a4bfca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Creating volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:20:59 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebf6a511-7d4a-4016-9f2c-42cb772f5cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6847cb9b-803f-4909-a029-77d112a3775d', 'volume_size': 2, 'source_volid': '55b46c1a-721a-4233-beab-4af0b5db8156', 'source_volstatus': 'available'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:59 devstack sudo[103897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da 1073741824 Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9d698a-529c-4ee3-a3b3-2450731ef37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:20:59 devstack sudo[103897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:20:59 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Volume volume-6847cb9b-803f-4909-a029-77d112a3775d (6847cb9b-803f-4909-a029-77d112a3775d): created successfully Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e9d698a-529c-4ee3-a3b3-2450731ef37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Flow 'volume_create_manager' (7b3ac4ef-6a0c-4669-9e99-7ec98bf8a5ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:20:59 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3c59058c-c048-4b64-abb1-23e985d094d6 tempest-VolumesCloneTest-1925559324 None] Created volume successfully. Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Acquiring lock "cinder-6847cb9b-803f-4909-a029-77d112a3775d-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Lock "cinder-6847cb9b-803f-4909-a029-77d112a3775d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Acquiring lock "cinder-quobyte-6847cb9b-803f-4909-a029-77d112a3775d" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Lock "cinder-quobyte-6847cb9b-803f-4909-a029-77d112a3775d" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef08df4-8219-48ec-8cad-fa1f4883f908]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:20:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:00 devstack sudo[103900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d Jun 19 04:21:00 devstack sudo[103900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-f370f3c0-fbf2-4979-8d22-dbc4771af16c req-aa94f5a0-476b-4105-928c-984adc3c39b8 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:00 devstack sudo[103897]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da 1073741824" returned: 0 in 0.999s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:00 devstack sudo[103924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da Jun 19 04:21:00 devstack sudo[103924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:00 devstack sudo[103900]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d" returned: 0 in 0.960s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:00 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d Jun 19 04:21:00 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:01 devstack sudo[103924]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da" returned: 0 in 1.272s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] <== create_volume: return (2321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.324s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-f370f3c0-fbf2-4979-8d22-dbc4771af16c req-aa94f5a0-476b-4105-928c-984adc3c39b8 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.412s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4be6460-01e2-4b3a-bd14-26406f79b164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c911d1-25a0-42f3-a5c1-60da016805a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6f245c-a283-43a4-8be4-4b0541983a5e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-f370f3c0-fbf2-4979-8d22-dbc4771af16c req-aa94f5a0-476b-4105-928c-984adc3c39b8 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:01 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Volume volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da (1fec8adf-3396-42ca-8ca7-91dd3933d2da): created successfully Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59c911d1-25a0-42f3-a5c1-60da016805a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Flow 'volume_create_manager' (08a0dae1-6682-48e0-9363-725f7c588eed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e7fc0968-5bf9-4e5a-ac44-2c8edd321fb5 tempest-SnapshotsActionsTest-1056132851 None] Created volume successfully. Jun 19 04:21:02 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6847cb9b-803f-4909-a029-77d112a3775d" returned: 0 in 1.122s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Lock "cinder-quobyte-6847cb9b-803f-4909-a029-77d112a3775d" released by "delete_volume" :: held 2.142s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:02 devstack sudo[103998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b Jun 19 04:21:02 devstack sudo[103998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Created reservations ['92df0d0d-2998-4a9b-8c2c-63ef4b21299d', '2be431d3-1e8d-4a52-9c29-3634ae8dac54', '4bc87f1d-a121-49aa-93d6-b3e494448fe8', '70ede3cb-2f89-4fea-ab71-a348a0050988'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:02 devstack sudo[104007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:21:02 devstack sudo[104007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:02 devstack sudo[103998]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-f370f3c0-fbf2-4979-8d22-dbc4771af16c req-aa94f5a0-476b-4105-928c-984adc3c39b8 tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b" returned: 0 in 1.006s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-f370f3c0-fbf2-4979-8d22-dbc4771af16c req-aa94f5a0-476b-4105-928c-984adc3c39b8 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.076s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.126s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Creating offline snapshot 481b03ed-00af-43c4-b197-4a9e8211baa3 of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[748a8d16-7f72-42bd-a2bc-5be9e1234fe1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-f370f3c0-fbf2-4979-8d22-dbc4771af16c req-aa94f5a0-476b-4105-928c-984adc3c39b8 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94ca9725-6280-468a-9947-fa917f009c9f', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:21:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:03 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-f370f3c0-fbf2-4979-8d22-dbc4771af16c req-aa94f5a0-476b-4105-928c-984adc3c39b8 tempest-TestServerVolumeAttachmentScenario-1207937865 None] attachment_update completed successfully. Jun 19 04:21:03 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da Jun 19 04:21:03 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Acquiring lock "cinder-55b46c1a-721a-4233-beab-4af0b5db8156-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:03 devstack sudo[104007]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.154s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:03 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:03 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Deleted volume successfully. Jun 19 04:21:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Lock "cinder-55b46c1a-721a-4233-beab-4af0b5db8156-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e6c9bb5a-f565-47e8-9227-ef790bc42f56 tempest-VolumesCloneTest-1925559324 None] Lock "cinder-6847cb9b-803f-4909-a029-77d112a3775d-delete_volume" released by "delete_volume" :: held 3.775s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Acquiring lock "cinder-quobyte-55b46c1a-721a-4233-beab-4af0b5db8156" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Lock "cinder-quobyte-55b46c1a-721a-4233-beab-4af0b5db8156" acquired by "delete_volume" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:03 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca12dec-a573-494d-bc61-701f324ebb18]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:03 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 Jun 19 04:21:03 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:04 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da" returned: 0 in 1.204s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:04 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 1G Jun 19 04:21:04 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:04 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156" returned: 0 in 1.004s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:04 devstack sudo[104412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156 Jun 19 04:21:04 devstack sudo[104412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:05 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 1G" returned: 0 in 1.250s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:05 devstack sudo[104418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:05 devstack sudo[104418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:05 devstack sudo[104412]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-55b46c1a-721a-4233-beab-4af0b5db8156" returned: 0 in 0.998s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:05 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Lock "cinder-quobyte-55b46c1a-721a-4233-beab-4af0b5db8156" released by "delete_volume" :: held 2.165s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:05 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Created reservations ['a9cb537f-b18d-4a90-8017-7d1cea341a4c', '5b2ef434-9ff1-4d4b-b1e0-32a3822fcd78', '780cf29c-4d58-499b-b153-e5b24f6a4b0c', 'e621b4e6-1f16-4c70-ae7f-f67cfc88dee5'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:06 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:21:06 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:06 devstack sudo[104418]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 0.990s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:06 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 is being set with open permissions: ugo+rw Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:06 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:06 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:06 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.961s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:06 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:07 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Deleted volume successfully. Jun 19 04:21:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfb22485-bf55-41a9-b99a-ca455b51bbfc tempest-VolumesCloneTest-1925559324 None] Lock "cinder-55b46c1a-721a-4233-beab-4af0b5db8156-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:07 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 0.905s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:07 devstack sudo[104432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.info Jun 19 04:21:07 devstack sudo[104432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:08 devstack sudo[104432]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.info" returned: 0 in 1.022s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:08 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.info is being set with open permissions: ugo+rw Jun 19 04:21:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:08 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.info Jun 19 04:21:08 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:09 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.info" returned: 0 in 1.012s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.528s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:09 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-19d1ba45-8e2b-4694-8f7d-693a3da5a760 tempest-SnapshotsActionsTest-1056132851 None] Create snapshot completed successfully Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Flow 'volume_create_manager' (e6c07c5b-cc02-4702-bee9-d19c96cde752) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eccfa20-3d13-4e5e-9d7e-2644596be64a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eccfa20-3d13-4e5e-9d7e-2644596be64a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1954935022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7128569a-d63f-4e98-803c-0ba9da8b334e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d998ae69d9e48599ca247ae2f69c77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:11Z,use_quota=True,user_id='780e522d0afd4d3593e763efc2e6d332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d290a727-6dfe-4431-bf1c-3b7e0addfd72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d290a727-6dfe-4431-bf1c-3b7e0addfd72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6954f7-8c2e-4058-b58e-3fe050d677c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf6954f7-8c2e-4058-b58e-3fe050d677c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7128569a-d63f-4e98-803c-0ba9da8b334e', 'volume_name': 'volume-7128569a-d63f-4e98-803c-0ba9da8b334e', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f09a74-ee08-4c5d-b7cf-ae820bf4cfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f09a74-ee08-4c5d-b7cf-ae820bf4cfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7140e46b-e249-4bad-90fa-6bf3a885b3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:10 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Volume 7128569a-d63f-4e98-803c-0ba9da8b334e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7128569a-d63f-4e98-803c-0ba9da8b334e', 'volume_size': 1} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1954935022',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7128569a-d63f-4e98-803c-0ba9da8b334e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4d998ae69d9e48599ca247ae2f69c77e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:11Z,use_quota=True,user_id='780e522d0afd4d3593e763efc2e6d332',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Creating volume 7128569a-d63f-4e98-803c-0ba9da8b334e {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:11 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:21:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:11 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e 1073741824 Jun 19 04:21:11 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:12 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e 1073741824" returned: 0 in 1.032s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:12 devstack sudo[104481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e Jun 19 04:21:12 devstack sudo[104481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:12 devstack sudo[104481]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e" returned: 0 in 0.717s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] <== create_volume: return (1816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.340s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7140e46b-e249-4bad-90fa-6bf3a885b3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7128569a-d63f-4e98-803c-0ba9da8b334e', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5748d32b-37ea-4f6a-b4dd-8e0bb1685146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Creating offline snapshot 7f2057cf-158d-4aff-9135-e37a48a47114 of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:21:12 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Volume volume-7128569a-d63f-4e98-803c-0ba9da8b334e (7128569a-d63f-4e98-803c-0ba9da8b334e): created successfully Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5748d32b-37ea-4f6a-b4dd-8e0bb1685146) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Flow 'volume_create_manager' (e6c07c5b-cc02-4702-bee9-d19c96cde752) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[468b6b83-7161-4b05-9544-9aaa7e5fdc83]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:12 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c45f85ff-d2af-4ee0-84df-8bd94c0adfe4 tempest-VolumesNegativeTest-857828284 None] Created volume successfully. Jun 19 04:21:13 devstack sudo[104487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:13 devstack sudo[104487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:13 devstack sudo[104487]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 0.995s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:13 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:13 devstack sudo[104495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 1G Jun 19 04:21:13 devstack sudo[104495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:14 devstack sudo[104495]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 1G" returned: 0 in 1.092s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:15 devstack sudo[104501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 Jun 19 04:21:15 devstack sudo[104501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-fdc52a07-9276-409e-8f08-850b0edb2cfa req-875b169a-39d5-419e-87b4-2b209cb7682c tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:15 devstack sudo[104501]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114" returned: 0 in 0.772s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:15 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 is being set with open permissions: ugo+rw Jun 19 04:21:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:15 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 Jun 19 04:21:15 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:16 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114" returned: 0 in 0.632s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.618s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-fdc52a07-9276-409e-8f08-850b0edb2cfa req-875b169a-39d5-419e-87b4-2b209cb7682c tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.784s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f99495c5-2d0e-4876-b954-7587dc4f7424]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-fdc52a07-9276-409e-8f08-850b0edb2cfa req-875b169a-39d5-419e-87b4-2b209cb7682c tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:16 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1b81302d-b6b0-4dfe-b55b-3860bb3f812b tempest-SnapshotsActionsTest-1056132851 None] Create snapshot completed successfully Jun 19 04:21:16 devstack sudo[104539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 Jun 19 04:21:16 devstack sudo[104539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-7f2057cf-158d-4aff-9135-e37a48a47114-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-7f2057cf-158d-4aff-9135-e37a48a47114-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" acquired by "delete_snapshot" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-quobyte-7f2057cf-158d-4aff-9135-e37a48a47114" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-7f2057cf-158d-4aff-9135-e37a48a47114" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Deleting offline snapshot 7f2057cf-158d-4aff-9135-e37a48a47114 of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] snapshot_file for this snap is: volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab42f68b-8684-45ca-87fb-8247387bdf59]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:17 devstack sudo[104541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 Jun 19 04:21:17 devstack sudo[104541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:17 devstack sudo[104539]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-fdc52a07-9276-409e-8f08-850b0edb2cfa req-875b169a-39d5-419e-87b4-2b209cb7682c tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5" returned: 0 in 0.747s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-fdc52a07-9276-409e-8f08-850b0edb2cfa req-875b169a-39d5-419e-87b4-2b209cb7682c tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.766s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-fdc52a07-9276-409e-8f08-850b0edb2cfa req-875b169a-39d5-419e-87b4-2b209cb7682c tempest-TestServerVolumeAttachmentScenario-1207937865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-5dcffd7c-e321-475a-bcde-0871f80497a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd9642f79-a1fc-4628-baa4-0be627228eb3', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:21:17 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-fdc52a07-9276-409e-8f08-850b0edb2cfa req-875b169a-39d5-419e-87b4-2b209cb7682c tempest-TestServerVolumeAttachmentScenario-1207937865 None] attachment_update completed successfully. Jun 19 04:21:17 devstack sudo[104541]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114" returned: 0 in 0.774s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db6961f-d447-45d7-b88c-cb90dbf615e0]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:17 devstack sudo[104549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:17 devstack sudo[104549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:18 devstack sudo[104549]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 0.880s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:18 devstack sudo[104560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 Jun 19 04:21:18 devstack sudo[104560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:19 devstack sudo[104560]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114" returned: 0 in 0.833s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:19 devstack sudo[104566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114 Jun 19 04:21:19 devstack sudo[104566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:20 devstack sudo[104566]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.7f2057cf-158d-4aff-9135-e37a48a47114" returned: 0 in 0.764s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-7f2057cf-158d-4aff-9135-e37a48a47114" released by "_delete_snapshot" :: held 3.361s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" released by "delete_snapshot" :: held 3.385s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:20 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Created reservations ['8c7fdaaf-6f23-4258-b7f0-bdf2dad9cf71', '5d7dbb58-6521-4f86-b15f-ca8f39bd64a2', 'c620fd82-a28a-44fd-a5b6-397995650b97', 'bf5c4aa9-9023-413c-a295-26d8ed3dc53a'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:20 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Delete snapshot completed successfully. Jun 19 04:21:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2baa1cbb-4505-481a-9980-f059a977fc91 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-7f2057cf-158d-4aff-9135-e37a48a47114-delete_snapshot" released by "delete_snapshot" :: held 3.539s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Creating offline snapshot 761e617f-1eaa-4808-90af-effcdedae227 of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:21:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1802048-e001-4c62-904c-fce89162c9e8]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:21 devstack sudo[104587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:21 devstack sudo[104587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 0.834s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:22 devstack sudo[104587]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:22 devstack sudo[104593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 1G Jun 19 04:21:22 devstack sudo[104593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:23 devstack sudo[104593]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 1G" returned: 0 in 1.082s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:23 devstack sudo[104605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 Jun 19 04:21:23 devstack sudo[104605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:23 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-6d9b2c2a-7957-4ee7-a3e2-90c878a3d85c req-464c4f8a-80d9-4eea-9aba-0196719620ad tempest-TestServerVolumeAttachmentScenario-1207937865 None] Terminate volume connection completed successfully. Jun 19 04:21:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-6d9b2c2a-7957-4ee7-a3e2-90c878a3d85c req-464c4f8a-80d9-4eea-9aba-0196719620ad tempest-TestServerVolumeAttachmentScenario-1207937865 None] Deleting attachment d9642f79-a1fc-4628-baa4-0be627228eb3. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:21:24 devstack sudo[104605]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227" returned: 0 in 0.857s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:24 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 is being set with open permissions: ugo+rw Jun 19 04:21:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:24 devstack sudo[104634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 Jun 19 04:21:24 devstack sudo[104634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:25 devstack sudo[104634]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227" returned: 0 in 0.751s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.629s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7e385fa3-9458-49ae-abe6-96816f54477d tempest-SnapshotsActionsTest-1056132851 None] Create snapshot completed successfully Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-761e617f-1eaa-4808-90af-effcdedae227-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-761e617f-1eaa-4808-90af-effcdedae227-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-quobyte-761e617f-1eaa-4808-90af-effcdedae227" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-761e617f-1eaa-4808-90af-effcdedae227" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Deleting offline snapshot 761e617f-1eaa-4808-90af-effcdedae227 of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] snapshot_file for this snap is: volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3395a543-1d87-4ee9-bd54-d5d7e330116b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:25 devstack sudo[104641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 Jun 19 04:21:25 devstack sudo[104641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:27 devstack sudo[104641]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227" returned: 0 in 1.342s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aefdd8f-a6d5-4c00-beb1-499c048b4673]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:27 devstack sudo[104702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:27 devstack sudo[104702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:27 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-734ceafb-81b0-4341-9268-e621fbff732b req-160bff4c-19cf-459b-976e-e019fb8bb04c tempest-TestServerVolumeAttachmentScenario-1207937865 None] Terminate volume connection completed successfully. Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-734ceafb-81b0-4341-9268-e621fbff732b req-160bff4c-19cf-459b-976e-e019fb8bb04c tempest-TestServerVolumeAttachmentScenario-1207937865 None] Deleting attachment 94ca9725-6280-468a-9947-fa917f009c9f. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Flow 'volume_create_manager' (f7f7a131-4882-4a15-8d27-b47db7c9e8ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad6c3c5-6fe9-4857-aa43-b58a2384e9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad6c3c5-6fe9-4857-aa43-b58a2384e9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-741898197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b300c425877c4b89b019b904a0f5e6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:28Z,use_quota=True,user_id='95dd2431ac0448a7a169be28f7d110dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2369fbe6-33b8-4202-80b2-867d7a047430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2369fbe6-33b8-4202-80b2-867d7a047430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2d6665-f40e-4b7c-9d53-2e023dcd4bfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c2d6665-f40e-4b7c-9d53-2e023dcd4bfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7', 'volume_name': 'volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e0356f-cd3b-403c-9ebd-8e911fbdc4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2e0356f-cd3b-403c-9ebd-8e911fbdc4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59630801-899b-4b4d-95c3-874d4bbcef53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:27 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Volume d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7', 'volume_size': 1} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:21:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-741898197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b300c425877c4b89b019b904a0f5e6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:21:28Z,use_quota=True,user_id='95dd2431ac0448a7a169be28f7d110dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Creating volume d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:21:27 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:21:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:28 devstack sudo[104733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 1073741824 Jun 19 04:21:28 devstack sudo[104733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:28 devstack sudo[104702]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 1.348s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:28 devstack sudo[104741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 Jun 19 04:21:28 devstack sudo[104741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:29 devstack sudo[104733]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 1073741824" returned: 0 in 1.299s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:29 devstack sudo[104764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 Jun 19 04:21:29 devstack sudo[104764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:30 devstack sudo[104741]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227" returned: 0 in 1.462s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:30 devstack sudo[104782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227 Jun 19 04:21:30 devstack sudo[104782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:30 devstack sudo[104764]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7" returned: 0 in 1.356s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] <== create_volume: return (2775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.779s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59630801-899b-4b4d-95c3-874d4bbcef53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239f49f5-deae-4b60-95d9-176452f4967a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:21:30 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Volume volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 (d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7): created successfully Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (239f49f5-deae-4b60-95d9-176452f4967a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Flow 'volume_create_manager' (f7f7a131-4882-4a15-8d27-b47db7c9e8ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:21:30 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-712607b6-a61d-48d6-ac46-1d44668404d0 tempest-AttachVolumeNegativeTest-568842932 None] Created volume successfully. Jun 19 04:21:30 devstack sudo[104782]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.761e617f-1eaa-4808-90af-effcdedae227" returned: 0 in 0.869s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-761e617f-1eaa-4808-90af-effcdedae227" released by "_delete_snapshot" :: held 5.153s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" released by "delete_snapshot" :: held 5.184s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:31 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Created reservations ['6debe6b7-8424-491f-969b-b9f9c887bee8', '74882d9d-b44b-40eb-ad94-c829e60669a3', '3cfcbb5b-5d40-4ddc-a73c-e8ba8d838811', 'dd7fd62d-3f4f-4513-834d-28bd46075740'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:31 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Delete snapshot completed successfully. Jun 19 04:21:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-17b2dec0-aecc-4379-acd2-3960c4a79add tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-761e617f-1eaa-4808-90af-effcdedae227-delete_snapshot" released by "delete_snapshot" :: held 5.480s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Creating offline snapshot bfc07b35-ca1a-47f6-ac4b-2555c235c79c of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:21:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a138da29-9e0e-44cc-8300-0dd836a32f8d]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:32 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:32 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:33 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 1.075s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:33 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c 1G Jun 19 04:21:33 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:34 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c 1G" returned: 0 in 1.332s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:34 devstack sudo[104887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c Jun 19 04:21:34 devstack sudo[104887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-7dd3f2be-b402-4ba0-affe-7f61777a6820 req-17c9a203-8c9d-48c8-8b2e-d8c27f8cecc2 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:35 devstack sudo[104887]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c" returned: 0 in 0.751s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:35 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c is being set with open permissions: ugo+rw Jun 19 04:21:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:35 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c Jun 19 04:21:35 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:36 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c" returned: 0 in 0.722s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.146s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-7dd3f2be-b402-4ba0-affe-7f61777a6820 req-17c9a203-8c9d-48c8-8b2e-d8c27f8cecc2 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.868s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:36 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67c2b4d-56d3-43bf-bad9-9fca6ac6e9c0]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7dd3f2be-b402-4ba0-affe-7f61777a6820 req-17c9a203-8c9d-48c8-8b2e-d8c27f8cecc2 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-19fe6d56-5724-40bc-8b74-6127e156d696 tempest-SnapshotsActionsTest-1056132851 None] Create snapshot completed successfully Jun 19 04:21:36 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 Jun 19 04:21:36 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:37 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7dd3f2be-b402-4ba0-affe-7f61777a6820 req-17c9a203-8c9d-48c8-8b2e-d8c27f8cecc2 tempest-AttachVolumeNegativeTest-568842932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-7dd3f2be-b402-4ba0-affe-7f61777a6820 req-17c9a203-8c9d-48c8-8b2e-d8c27f8cecc2 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.821s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-7dd3f2be-b402-4ba0-affe-7f61777a6820 req-17c9a203-8c9d-48c8-8b2e-d8c27f8cecc2 tempest-AttachVolumeNegativeTest-568842932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2bf68753-4ca2-495d-8b14-e139fa7cb37a', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:21:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-7dd3f2be-b402-4ba0-affe-7f61777a6820 req-17c9a203-8c9d-48c8-8b2e-d8c27f8cecc2 tempest-AttachVolumeNegativeTest-568842932 None] attachment_update completed successfully. Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-bfc07b35-ca1a-47f6-ac4b-2555c235c79c-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-bfc07b35-ca1a-47f6-ac4b-2555c235c79c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-quobyte-bfc07b35-ca1a-47f6-ac4b-2555c235c79c" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-bfc07b35-ca1a-47f6-ac4b-2555c235c79c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Deleting offline snapshot bfc07b35-ca1a-47f6-ac4b-2555c235c79c of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] snapshot_file for this snap is: volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7df641a5-e273-4779-9611-f6235d37c085]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:37 devstack sudo[104933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c Jun 19 04:21:37 devstack sudo[104933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:38 devstack sudo[104933]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c" returned: 0 in 0.780s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ab822aa-a793-47ff-be46-7a0fecbc9f98]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:38 devstack sudo[105300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:38 devstack sudo[105300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:39 devstack sudo[105300]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 0.931s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:39 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c Jun 19 04:21:39 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "cinder-5dcffd7c-e321-475a-bcde-0871f80497a5-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "cinder-5dcffd7c-e321-475a-bcde-0871f80497a5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "cinder-quobyte-5dcffd7c-e321-475a-bcde-0871f80497a5" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "cinder-quobyte-5dcffd7c-e321-475a-bcde-0871f80497a5" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:39 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a99a8d7-b604-4cd8-a6a0-a7cd3a1c6b76]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:39 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 Jun 19 04:21:39 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:40 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c" returned: 0 in 0.817s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:40 devstack sudo[105313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c Jun 19 04:21:40 devstack sudo[105313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:40 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5" returned: 0 in 0.844s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:40 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5 Jun 19 04:21:40 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:40 devstack sudo[105313]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.bfc07b35-ca1a-47f6-ac4b-2555c235c79c" returned: 0 in 0.699s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-bfc07b35-ca1a-47f6-ac4b-2555c235c79c" released by "_delete_snapshot" :: held 3.356s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" released by "delete_snapshot" :: held 3.384s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Created reservations ['8397bd2a-f170-4020-8edb-0a6f369b5f4f', '1975e3e1-7391-47a5-bd88-ce114b0b131f', '8c09c393-31b1-40ba-8d5d-cfec96e37507', 'a0e0f7bd-6769-4e11-99c9-af7623ca6131'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Delete snapshot completed successfully. Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff7838be-79f2-4310-99b1-5e2d445a75c9 tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-bfc07b35-ca1a-47f6-ac4b-2555c235c79c-delete_snapshot" released by "delete_snapshot" :: held 3.573s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:41 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5dcffd7c-e321-475a-bcde-0871f80497a5" returned: 0 in 0.695s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "cinder-quobyte-5dcffd7c-e321-475a-bcde-0871f80497a5" released by "delete_volume" :: held 1.593s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Created reservations ['efc342b0-c060-4963-b48d-137f16b66839', '81365cdc-5213-4812-b1da-d517df2a50d3', '0d00ad71-a28b-4663-98f3-6c63b8d60871', '99d9e096-700f-4960-86e3-58eb5fa5e151'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:41 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:21:41 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "cinder-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "cinder-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:42 devstack sudo[105327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:21:42 devstack sudo[105327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "cinder-quobyte-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "cinder-quobyte-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e70bae3d-32ac-43fd-9c81-ca027ea0e11e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:42 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b Jun 19 04:21:42 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:42 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.974s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:42 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Deleted volume successfully. Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Creating offline snapshot 69c4ad26-1ad4-4ec6-866c-87e9115ee43b of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[53fc5b75-d2cf-4e42-b1f4-2d083d569135]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7e59b26b-86f6-4fae-84de-8bf0fa4c3d84 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "cinder-5dcffd7c-e321-475a-bcde-0871f80497a5-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:42 devstack sudo[105333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:42 devstack sudo[105333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:43 devstack sudo[105327]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.151s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:21:43 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b" returned: 0 in 1.342s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:43 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b Jun 19 04:21:43 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:43 devstack sudo[105333]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 1.007s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:43 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b 1G Jun 19 04:21:43 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:44 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b" returned: 0 in 0.684s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "cinder-quobyte-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b" released by "delete_volume" :: held 2.098s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Created reservations ['cbdf5fe9-65e8-412e-a35e-62f4a64f3452', '66dd410b-a284-4cf2-ba66-ebf008c7edd3', 'f036b69b-ddd8-4856-878f-de74b24e808b', '59cf72fe-b454-47bb-a33b-3c8921dc58eb'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:44 devstack sudo[105358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:21:44 devstack sudo[105358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:44 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b 1G" returned: 0 in 1.074s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:44 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b Jun 19 04:21:44 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-2d454673-8b41-44f2-8060-c633bb2562f7 req-176a6285-2484-47b4-bb12-26e3ec86e9a4 tempest-AttachVolumeNegativeTest-568842932 None] Terminate volume connection completed successfully. Jun 19 04:21:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-2d454673-8b41-44f2-8060-c633bb2562f7 req-176a6285-2484-47b4-bb12-26e3ec86e9a4 tempest-AttachVolumeNegativeTest-568842932 None] Deleting attachment 2bf68753-4ca2-495d-8b14-e139fa7cb37a. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:21:45 devstack sudo[105358]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.809s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:45 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Deleted volume successfully. Jun 19 04:21:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a5a143a-7b0a-44a0-afb1-bfc5239dcaa4 tempest-TestServerVolumeAttachmentScenario-1207937865 None] Lock "cinder-b5b2ca5c-a284-410f-a9e7-ae6d05d1c44b-delete_volume" released by "delete_volume" :: held 3.231s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:45 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b" returned: 0 in 0.843s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:45 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b is being set with open permissions: ugo+rw Jun 19 04:21:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:45 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b Jun 19 04:21:45 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:46 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b" returned: 0 in 0.777s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.857s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1ac360b9-cff5-44ca-bfc9-a025f9fed09e tempest-SnapshotsActionsTest-1056132851 None] Create snapshot completed successfully Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-69c4ad26-1ad4-4ec6-866c-87e9115ee43b-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-69c4ad26-1ad4-4ec6-866c-87e9115ee43b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" acquired by "delete_snapshot" :: waited 0.033s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Acquiring lock "cinder-quobyte-69c4ad26-1ad4-4ec6-866c-87e9115ee43b" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-69c4ad26-1ad4-4ec6-866c-87e9115ee43b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Deleting offline snapshot 69c4ad26-1ad4-4ec6-866c-87e9115ee43b of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] snapshot_file for this snap is: volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a3f5dd4-0dd8-4487-bc34-902e5ec0ee06]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:47 devstack sudo[105399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b Jun 19 04:21:47 devstack sudo[105399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Acquiring lock "cinder-7128569a-d63f-4e98-803c-0ba9da8b334e-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Lock "cinder-7128569a-d63f-4e98-803c-0ba9da8b334e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:47 devstack sudo[105399]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b" returned: 0 in 0.965s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Acquiring lock "cinder-quobyte-7128569a-d63f-4e98-803c-0ba9da8b334e" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:48 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[324c99d6-4b52-461b-bd63-6a00e8522153]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Lock "cinder-quobyte-7128569a-d63f-4e98-803c-0ba9da8b334e" acquired by "delete_volume" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:48 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50e300a-4c08-493e-8feb-e6515a7606de]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:48 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:48 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:48 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e Jun 19 04:21:48 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:49 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 1.271s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:49 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b Jun 19 04:21:49 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:49 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e" returned: 0 in 1.352s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:49 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e Jun 19 04:21:49 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:50 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7128569a-d63f-4e98-803c-0ba9da8b334e" returned: 0 in 0.990s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:50 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b" returned: 0 in 1.135s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Lock "cinder-quobyte-7128569a-d63f-4e98-803c-0ba9da8b334e" released by "delete_volume" :: held 2.405s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:50 devstack sudo[105470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b Jun 19 04:21:50 devstack sudo[105470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Created reservations ['37f730ad-0074-436c-b6da-26069aa76bf5', '3efab933-f1f7-4e75-ae7a-3385a67f60a0', '47c7d40c-0e7e-4aef-8d57-6d3381e6d651', '5b7a4ba9-deb8-4dbf-ab22-9960e594b4df'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:50 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:21:50 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:51 devstack sudo[105470]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.69c4ad26-1ad4-4ec6-866c-87e9115ee43b" returned: 0 in 0.967s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:51 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.781s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:51 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:21:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-69c4ad26-1ad4-4ec6-866c-87e9115ee43b" released by "_delete_snapshot" :: held 4.509s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Deleted volume successfully. Jun 19 04:21:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" released by "delete_snapshot" :: held 4.548s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-37edd7ba-eafe-4734-b85a-2f8ffb67ec9f tempest-VolumesNegativeTest-857828284 None] Lock "cinder-7128569a-d63f-4e98-803c-0ba9da8b334e-delete_volume" released by "delete_volume" :: held 3.581s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:51 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Created reservations ['1ad0bdbb-9826-4fd5-9adf-7178f97f5c98', '261c35b1-b69f-40ea-bc83-b12aca1b16e1', 'dc216f79-009e-43ec-a560-4740cde7e0fa', '33d9d64b-9c06-4d70-876c-d63722c90f72'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Delete snapshot completed successfully. Jun 19 04:21:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0cdcf18-90a9-4e6c-8da2-83f8df87bbae tempest-SnapshotsActionsTest-72006841 None] Lock "cinder-69c4ad26-1ad4-4ec6-866c-87e9115ee43b-delete_snapshot" released by "delete_snapshot" :: held 4.770s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "cinder-481b03ed-00af-43c4-b197-4a9e8211baa3-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-481b03ed-00af-43c4-b197-4a9e8211baa3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" acquired by "delete_snapshot" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "cinder-quobyte-481b03ed-00af-43c4-b197-4a9e8211baa3" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-quobyte-481b03ed-00af-43c4-b197-4a9e8211baa3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Deleting offline snapshot 481b03ed-00af-43c4-b197-4a9e8211baa3 of volume 1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] snapshot_file for this snap is: volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee276137-5699-455b-8fb4-66d28f1b2a63]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:53 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:53 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:53 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 0.876s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:21:53 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[719c9dd0-02c8-4df0-94e5-daf7b7606f32]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:53 devstack sudo[105486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da Jun 19 04:21:53 devstack sudo[105486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:54 devstack sudo[105486]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da" returned: 0 in 1.131s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:54 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:54 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:55 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 0.919s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:55 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3 Jun 19 04:21:55 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:56 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da.481b03ed-00af-43c4-b197-4a9e8211baa3" returned: 0 in 0.844s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:56 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=82,cinder:UPDATE=87,cinder:DELETE=5,cinder:INSERT=24 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:21:56 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=83,cinder:SELECT=87,cinder:INSERT=17,cinder:DELETE=9 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:21:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-quobyte-481b03ed-00af-43c4-b197-4a9e8211baa3" released by "_delete_snapshot" :: held 4.002s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" released by "delete_snapshot" :: held 4.032s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:56 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Created reservations ['b4d7476c-b744-4b63-865b-6a18de7cdd39', 'e3c64ca3-b5f7-4bbf-a945-ab2fb605a8dd', '2ca46b42-2b4d-45a9-9a61-4560c6c41ae7', '6edf90b2-5c1a-445a-ab0e-0d91528f249a'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Delete snapshot completed successfully. Jun 19 04:21:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e5d65ecf-883e-4e38-ba79-bf7e5568a590 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-481b03ed-00af-43c4-b197-4a9e8211baa3-delete_snapshot" released by "delete_snapshot" :: held 4.200s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "cinder-1fec8adf-3396-42ca-8ca7-91dd3933d2da-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-1fec8adf-3396-42ca-8ca7-91dd3933d2da-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:21:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:21:57 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dde8f7-6359-46c2-97ef-29797b02192a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:21:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:57 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da Jun 19 04:21:57 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:58 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da" returned: 0 in 0.897s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:58 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da Jun 19 04:21:58 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:21:59 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Jun 19 04:21:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1fec8adf-3396-42ca-8ca7-91dd3933d2da" returned: 0 in 0.854s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:21:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-quobyte-1fec8adf-3396-42ca-8ca7-91dd3933d2da" released by "delete_volume" :: held 1.834s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:21:59 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Created reservations ['0bf6d072-9a8b-4ecc-ab5d-65fe3f8d1a58', 'a6c59f06-90af-42de-8a3b-cfe51a529be4', 'a156268a-b6ad-40e4-8702-ca6eca41dae9', '28edd3cd-c446-4b8e-87cd-c8e296d6975c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:21:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:21:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:21:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:21:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:21:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:21:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:21:59 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:21:59 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:00 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.769s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:00 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:00 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Deleted volume successfully. Jun 19 04:22:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-141cb97f-9c42-462a-be23-997003369807 tempest-SnapshotsActionsTest-1056132851 None] Lock "cinder-1fec8adf-3396-42ca-8ca7-91dd3933d2da-delete_volume" released by "delete_volume" :: held 2.912s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:06 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (5c35c385-8404-449c-86d5-0f1d32d9b5fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe529d7c-5056-4024-a677-e28fddbe2576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe529d7c-5056-4024-a677-e28fddbe2576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1767723890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ad0928-409c-49f6-8d2d-03081af7f750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0211aae816c4d12a1bc615b3f3231c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:07Z,use_quota=True,user_id='990f206d829c4ea085ee39182050b150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477112f7-9e03-4bf1-ab47-fcd3e7a08a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477112f7-9e03-4bf1-ab47-fcd3e7a08a4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50704c5d-3975-464c-8830-890590d62639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50704c5d-3975-464c-8830-890590d62639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09ad0928-409c-49f6-8d2d-03081af7f750', 'volume_name': 'volume-09ad0928-409c-49f6-8d2d-03081af7f750', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0528d56-f636-42db-bdb8-c01f2c596340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0528d56-f636-42db-bdb8-c01f2c596340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189ab55e-0b95-456d-ae77-83f9f8782cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:07 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Volume 09ad0928-409c-49f6-8d2d-03081af7f750: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09ad0928-409c-49f6-8d2d-03081af7f750', 'volume_size': 1} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1767723890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09ad0928-409c-49f6-8d2d-03081af7f750,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0211aae816c4d12a1bc615b3f3231c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:07Z,use_quota=True,user_id='990f206d829c4ea085ee39182050b150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Creating volume 09ad0928-409c-49f6-8d2d-03081af7f750 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:07 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:22:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:07 devstack sudo[105523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 1073741824 Jun 19 04:22:07 devstack sudo[105523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:08 devstack sudo[105523]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 1073741824" returned: 0 in 1.209s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:08 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 Jun 19 04:22:08 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:09 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750" returned: 0 in 0.943s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189ab55e-0b95-456d-ae77-83f9f8782cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09ad0928-409c-49f6-8d2d-03081af7f750', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63d0cb1-0ebe-4bc1-a5ea-893e3fbde500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:09 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Volume volume-09ad0928-409c-49f6-8d2d-03081af7f750 (09ad0928-409c-49f6-8d2d-03081af7f750): created successfully Jun 19 04:22:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a63d0cb1-0ebe-4bc1-a5ea-893e3fbde500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (5c35c385-8404-449c-86d5-0f1d32d9b5fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:09 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-bd88c245-2f4b-44d1-8da8-335c984dd46d tempest-VolumesSnapshotTestJSON-904510987 None] Created volume successfully. Jun 19 04:22:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Creating offline snapshot 2afdda84-cda9-4e7a-8fa5-0fb84f526542 of volume 09ad0928-409c-49f6-8d2d-03081af7f750 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:22:10 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8b3338-8571-4c29-83f2-cccb4261d2d3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:10 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 Jun 19 04:22:10 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:11 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750" returned: 0 in 1.175s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:11 devstack sudo[105575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 1G Jun 19 04:22:11 devstack sudo[105575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:12 devstack sudo[105575]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 1G" returned: 0 in 1.240s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ad0928-409c-49f6-8d2d-03081af7f750 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:12 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ad0928-409c-49f6-8d2d-03081af7f750 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 Jun 19 04:22:12 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:13 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09ad0928-409c-49f6-8d2d-03081af7f750 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542" returned: 0 in 1.028s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:13 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 is being set with open permissions: ugo+rw Jun 19 04:22:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:13 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 Jun 19 04:22:13 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:14 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542" returned: 0 in 1.060s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:14 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.info Jun 19 04:22:14 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:15 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.info" returned: 0 in 0.858s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:15 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.info is being set with open permissions: ugo+rw Jun 19 04:22:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:15 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.info Jun 19 04:22:15 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:16 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.info" returned: 0 in 1.008s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.508s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:16 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c481d8fa-441d-42f7-ab1e-f21a330527af tempest-VolumesSnapshotTestJSON-904510987 None] Create snapshot completed successfully Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-2afdda84-cda9-4e7a-8fa5-0fb84f526542-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-2afdda84-cda9-4e7a-8fa5-0fb84f526542-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-09ad0928-409c-49f6-8d2d-03081af7f750" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-09ad0928-409c-49f6-8d2d-03081af7f750" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-2afdda84-cda9-4e7a-8fa5-0fb84f526542" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-2afdda84-cda9-4e7a-8fa5-0fb84f526542" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Deleting offline snapshot 2afdda84-cda9-4e7a-8fa5-0fb84f526542 of volume 09ad0928-409c-49f6-8d2d-03081af7f750 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] snapshot_file for this snap is: volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[588435d4-98ed-4606-a4e9-eed51eddd158]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:18 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 Jun 19 04:22:18 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:19 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542" returned: 0 in 1.095s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09ad0928-409c-49f6-8d2d-03081af7f750(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:22:19 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[52de807f-c4d8-4361-b90d-7d061693c0a8]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:19 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 Jun 19 04:22:19 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:20 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750" returned: 0 in 0.925s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:20 devstack sudo[105625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 Jun 19 04:22:20 devstack sudo[105625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:21 devstack sudo[105625]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542" returned: 0 in 0.884s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:21 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542 Jun 19 04:22:21 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:21 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750.2afdda84-cda9-4e7a-8fa5-0fb84f526542" returned: 0 in 0.739s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-2afdda84-cda9-4e7a-8fa5-0fb84f526542" released by "_delete_snapshot" :: held 3.784s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-09ad0928-409c-49f6-8d2d-03081af7f750" released by "delete_snapshot" :: held 3.809s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:22 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Created reservations ['24a4df74-6dbb-4c1d-9bf2-7e6cc40c4755', 'fa84e84c-413e-48d7-b5d7-abe7c2885e3a', '387454cb-71ac-4148-bcfb-b87951f0302a', '5441b510-41c5-4791-9425-d6db4f57970d'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Delete snapshot completed successfully. Jun 19 04:22:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7bc31d7a-a2cb-4a1c-bfd0-9737a0cb2bc7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-2afdda84-cda9-4e7a-8fa5-0fb84f526542-delete_snapshot" released by "delete_snapshot" :: held 4.052s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (8223e945-e967-4a07-a622-2a734cd11d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db678b63-f0bd-4558-b8fb-0e2d237c492e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db678b63-f0bd-4558-b8fb-0e2d237c492e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-420916916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb8c020-c85e-4df0-b83e-9db54134dc76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0211aae816c4d12a1bc615b3f3231c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:23Z,use_quota=True,user_id='990f206d829c4ea085ee39182050b150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94fa52c-53c0-43e5-a543-3009aac6fdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f94fa52c-53c0-43e5-a543-3009aac6fdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9233c121-9a8b-47d0-b2da-83ba88af1bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9233c121-9a8b-47d0-b2da-83ba88af1bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfb8c020-c85e-4df0-b83e-9db54134dc76', 'volume_name': 'volume-bfb8c020-c85e-4df0-b83e-9db54134dc76', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48d58ee-bb37-41c4-ab29-b2cb56969140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f48d58ee-bb37-41c4-ab29-b2cb56969140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95682165-9fe7-4560-b35a-0340c2354313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:23 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Volume bfb8c020-c85e-4df0-b83e-9db54134dc76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfb8c020-c85e-4df0-b83e-9db54134dc76', 'volume_size': 1} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-420916916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfb8c020-c85e-4df0-b83e-9db54134dc76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0211aae816c4d12a1bc615b3f3231c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:23Z,use_quota=True,user_id='990f206d829c4ea085ee39182050b150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Creating volume bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:23 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:22:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:23 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 1073741824 Jun 19 04:22:23 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Flow 'volume_create_manager' (f7acef0d-272b-4502-bd4e-451e36e3d11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:25 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb4d3ba-e5d6-412a-b537-6a263fa0e86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 1073741824" returned: 0 in 1.612s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcb4d3ba-e5d6-412a-b537-6a263fa0e86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-251358299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc4ca6a-e457-4e5a-8810-b5a12554dd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51c7c91558f43ac8d90751d8a57786b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:25Z,use_quota=True,user_id='81f3993e037e4072b2afc9312a5f9fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529be15e-256a-4a92-a0ea-a357c4ba807b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529be15e-256a-4a92-a0ea-a357c4ba807b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e868c815-cb60-4fbb-b670-ca192245dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e868c815-cb60-4fbb-b670-ca192245dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdc4ca6a-e457-4e5a-8810-b5a12554dd56', 'volume_name': 'volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310a6a89-ea84-4bcb-961b-219f0be1b965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (310a6a89-ea84-4bcb-961b-219f0be1b965) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af7ad0c-35e7-44ea-96e1-e6f39c86dae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:25 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Volume bdc4ca6a-e457-4e5a-8810-b5a12554dd56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56', 'volume_size': 1} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:25 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 Jun 19 04:22:25 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:25 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76" returned: 0 in 0.763s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] <== create_volume: return (2483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.485s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.796s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-251358299',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdc4ca6a-e457-4e5a-8810-b5a12554dd56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51c7c91558f43ac8d90751d8a57786b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:25Z,use_quota=True,user_id='81f3993e037e4072b2afc9312a5f9fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Creating volume bdc4ca6a-e457-4e5a-8810-b5a12554dd56 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:25 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:25 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 1073741824 Jun 19 04:22:25 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95682165-9fe7-4560-b35a-0340c2354313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfb8c020-c85e-4df0-b83e-9db54134dc76', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdec08c-60b8-48aa-9222-2654b95a0e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:26 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Volume volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 (bfb8c020-c85e-4df0-b83e-9db54134dc76): created successfully Jun 19 04:22:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fdec08c-60b8-48aa-9222-2654b95a0e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (8223e945-e967-4a07-a622-2a734cd11d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:26 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-db430546-d4e3-4444-8d9f-b8bc7cd159ed tempest-VolumesSnapshotTestJSON-904510987 None] Created volume successfully. Jun 19 04:22:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:27 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 1073741824" returned: 0 in 1.288s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:27 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 Jun 19 04:22:27 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:28 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56" returned: 0 in 1.408s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] <== create_volume: return (2762ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.769s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.198s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af7ad0c-35e7-44ea-96e1-e6f39c86dae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb58b42a-5471-4a8d-b025-15393a5b0833) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Creating offline snapshot 95249deb-0f0f-4946-b5a5-600f13546135 of volume bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:22:28 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Volume volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 (bdc4ca6a-e457-4e5a-8810-b5a12554dd56): created successfully Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb58b42a-5471-4a8d-b025-15393a5b0833) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Flow 'volume_create_manager' (f7acef0d-272b-4502-bd4e-451e36e3d11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae0cbfc-117a-4419-9ca4-ea7a3dbdc3c5]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-27626ed4-d6ba-4017-b100-2fa0c61aade9 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Created volume successfully. Jun 19 04:22:29 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 Jun 19 04:22:29 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Acquiring lock "cinder-bdc4ca6a-e457-4e5a-8810-b5a12554dd56-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "cinder-bdc4ca6a-e457-4e5a-8810-b5a12554dd56-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Acquiring lock "cinder-quobyte-bdc4ca6a-e457-4e5a-8810-b5a12554dd56" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "cinder-quobyte-bdc4ca6a-e457-4e5a-8810-b5a12554dd56" acquired by "delete_volume" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:30 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[073059e5-72d4-4979-bb68-654ee370318d]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:30 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 Jun 19 04:22:30 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:30 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76" returned: 0 in 1.838s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:30 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 1G Jun 19 04:22:30 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:31 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56" returned: 0 in 1.441s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:31 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56 Jun 19 04:22:31 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:32 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 1G" returned: 0 in 1.739s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:32 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 Jun 19 04:22:32 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:33 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bdc4ca6a-e457-4e5a-8810-b5a12554dd56" returned: 0 in 1.642s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "cinder-quobyte-bdc4ca6a-e457-4e5a-8810-b5a12554dd56" released by "delete_volume" :: held 3.191s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:33 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135" returned: 0 in 1.209s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:33 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 is being set with open permissions: ugo+rw Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Created reservations ['c07e69f6-a272-427d-ba94-fa740a1da597', '15efc2ac-e964-4693-890a-dabb1ffef4ad', 'bc57cf01-8075-4f92-bd0d-7e2e12a91325', 'a8ca33eb-bffb-4e52-a2eb-eb4999f6f494'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:33 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 Jun 19 04:22:33 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:34 devstack sudo[105778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:22:34 devstack sudo[105778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:34 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135" returned: 0 in 1.283s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:35 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.info Jun 19 04:22:35 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:35 devstack sudo[105778]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.102s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:35 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:35 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Deleted volume successfully. Jun 19 04:22:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cf04098a-4801-4418-a85c-488b1b4780f8 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "cinder-bdc4ca6a-e457-4e5a-8810-b5a12554dd56-delete_volume" released by "delete_volume" :: held 5.024s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:35 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.info" returned: 0 in 0.980s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:35 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.info is being set with open permissions: ugo+rw Jun 19 04:22:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:35 devstack sudo[105785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.info Jun 19 04:22:35 devstack sudo[105785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:35 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Flow 'volume_create_manager' (08b523ba-2764-486c-ad4a-f74ce2bc2e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b0379f-6f85-43b4-8210-6e56c005e22c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b0379f-6f85-43b4-8210-6e56c005e22c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2066432909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51c7c91558f43ac8d90751d8a57786b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:36Z,use_quota=True,user_id='81f3993e037e4072b2afc9312a5f9fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23325460-b19e-48ca-abf1-1cb35149c598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23325460-b19e-48ca-abf1-1cb35149c598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1cdf35-553e-4db7-84f8-560ff0ce9b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be1cdf35-553e-4db7-84f8-560ff0ce9b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe', 'volume_name': 'volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4eaeec8-dbdc-4f44-842c-5458ba64c5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4eaeec8-dbdc-4f44-842c-5458ba64c5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89552ff1-1159-417b-b481-2fd0100342cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Volume 0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe', 'volume_size': 1} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Flow 'volume_create_manager' (5505842c-b641-458d-90b4-322a5e080eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd3f745-6578-4ff2-9b06-66487a57abdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6cd3f745-6578-4ff2-9b06-66487a57abdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910372134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6eba0f-f60b-4e58-8658-41ee0042e676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322abf8a3ec8460699ad582769911053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:37Z,use_quota=True,user_id='3496981fed3341c2a8ee855c94fabc24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f983f4a-e2e7-439e-b846-142b1f71547b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f983f4a-e2e7-439e-b846-142b1f71547b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13abcd7f-8a3e-487d-bd26-1ca4e147d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13abcd7f-8a3e-487d-bd26-1ca4e147d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc6eba0f-f60b-4e58-8658-41ee0042e676', 'volume_name': 'volume-fc6eba0f-f60b-4e58-8658-41ee0042e676', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d4b200-8af0-4541-bc01-c1d321007e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d4b200-8af0-4541-bc01-c1d321007e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1451270a-8156-4427-a4d6-2ca1aaa4dcef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Volume fc6eba0f-f60b-4e58-8658-41ee0042e676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc6eba0f-f60b-4e58-8658-41ee0042e676', 'volume_size': 1} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:36 devstack sudo[105785]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.info" returned: 0 in 0.837s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.105s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.714s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2066432909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f51c7c91558f43ac8d90751d8a57786b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:36Z,use_quota=True,user_id='81f3993e037e4072b2afc9312a5f9fe2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Creating volume 0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:36 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:22:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:36 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe 1073741824 Jun 19 04:22:36 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b7531e96-0abc-4110-ab0c-15d3390af822 tempest-VolumesSnapshotTestJSON-904510987 None] Create snapshot completed successfully Jun 19 04:22:37 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe 1073741824" returned: 0 in 1.118s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:38 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe Jun 19 04:22:38 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (36a3a217-ee9a-4fb4-8954-6f2076b0d3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fcf98d-a262-4cdf-a092-f6c7e415f6eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91fcf98d-a262-4cdf-a092-f6c7e415f6eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1244632294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a909a486-d675-462b-8bd5-0618b7f0632d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0211aae816c4d12a1bc615b3f3231c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=95249deb-0f0f-4946-b5a5-600f13546135,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:38Z,use_quota=True,user_id='990f206d829c4ea085ee39182050b150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b516e8-1b1f-4b1a-b061-3b544026175f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55b516e8-1b1f-4b1a-b061-3b544026175f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cf5b3b-bdf7-4352-a3dd-77a144af25f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (16cf5b3b-bdf7-4352-a3dd-77a144af25f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a909a486-d675-462b-8bd5-0618b7f0632d', 'volume_name': 'volume-a909a486-d675-462b-8bd5-0618b7f0632d', 'volume_size': 2, 'snapshot_id': '95249deb-0f0f-4946-b5a5-600f13546135'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a713f3f6-74ba-482c-be96-b8cbbc0060b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a713f3f6-74ba-482c-be96-b8cbbc0060b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a830f-5148-425b-be44-d1efa6991370) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:38 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Volume a909a486-d675-462b-8bd5-0618b7f0632d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a909a486-d675-462b-8bd5-0618b7f0632d', 'volume_size': 2, 'snapshot_id': '95249deb-0f0f-4946-b5a5-600f13546135'} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:38 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe" returned: 0 in 0.861s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] <== create_volume: return (2038ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.044s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.123s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1910372134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc6eba0f-f60b-4e58-8658-41ee0042e676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322abf8a3ec8460699ad582769911053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:37Z,use_quota=True,user_id='3496981fed3341c2a8ee855c94fabc24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Creating volume fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:38 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:38 devstack sudo[105800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 1073741824 Jun 19 04:22:38 devstack sudo[105800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89552ff1-1159-417b-b481-2fd0100342cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eeec310-c6c7-4ccf-9235-32cbeb60322e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:38 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Volume volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe (0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe): created successfully Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eeec310-c6c7-4ccf-9235-32cbeb60322e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Flow 'volume_create_manager' (08b523ba-2764-486c-ad4a-f74ce2bc2e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1a9a318a-251d-4993-8838-6d429cf7cf00 tempest-VolumeQuotasAdminTestJSON-1263448762 None] Created volume successfully. Jun 19 04:22:39 devstack sudo[105800]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 1073741824" returned: 0 in 1.086s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:40 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 Jun 19 04:22:40 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f7b59f09-783e-454c-b637-214921fa1b3c tempest-VolumeQuotasAdminTestJSON-405037375 None] Transfer volume completed successfully. Jun 19 04:22:40 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676" returned: 0 in 0.806s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] <== create_volume: return (1970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.974s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.481s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-95249deb-0f0f-4946-b5a5-600f13546135-a909a486-d675-462b-8bd5-0618b7f0632d" by "_create_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1451270a-8156-4427-a4d6-2ca1aaa4dcef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc6eba0f-f60b-4e58-8658-41ee0042e676', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cba774-e987-4cd4-aa1e-467e803eb524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-95249deb-0f0f-4946-b5a5-600f13546135-a909a486-d675-462b-8bd5-0618b7f0632d" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Creating volume a909a486-d675-462b-8bd5-0618b7f0632d from snapshot 95249deb-0f0f-4946-b5a5-600f13546135 {{(pid=93769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-a909a486-d675-462b-8bd5-0618b7f0632d" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:40 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Volume volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 (fc6eba0f-f60b-4e58-8658-41ee0042e676): created successfully Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52cba774-e987-4cd4-aa1e-467e803eb524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Flow 'volume_create_manager' (5505842c-b641-458d-90b4-322a5e080eb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-a909a486-d675-462b-8bd5-0618b7f0632d" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] snapshot: 95249deb-0f0f-4946-b5a5-600f13546135, volume: a909a486-d675-462b-8bd5-0618b7f0632d, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-aaa7e3da-7464-445c-a157-21c1901d92db tempest-TestStampPattern-688608864 None] Created volume successfully. Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e58de7-e381-4a3f-92bd-ff23652f15e5]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:41 devstack sudo[105828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 Jun 19 04:22:41 devstack sudo[105828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Acquiring lock "cinder-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Lock "cinder-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Acquiring lock "cinder-quobyte-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Lock "cinder-quobyte-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f5986f-a8f4-450b-8f94-a6378b621691]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:41 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe Jun 19 04:22:41 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:41 devstack sudo[105828]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135" returned: 0 in 0.819s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfb8c020-c85e-4df0-b83e-9db54134dc76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0c93824-36ff-490c-8c36-e28316f450db]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:41 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 Jun 19 04:22:41 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:41 devstack sudo[105838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:22:41 devstack sudo[105838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:42 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe" returned: 0 in 0.810s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:42 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe Jun 19 04:22:42 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:42 devstack sudo[105838]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.691s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:22:42 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76" returned: 0 in 0.866s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:42 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d Jun 19 04:22:42 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:42 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe" returned: 0 in 0.713s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Lock "cinder-quobyte-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe" released by "delete_volume" :: held 1.580s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:43 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Created reservations ['72ebad5e-68ab-4fed-8138-40f06a04be5f', '91944a3b-06f1-4210-9f00-a20390c5370a', 'ee21b821-ad3c-434c-9116-1b89430aa062', 'cdb0613f-d597-42ff-9a55-b76beda1429d'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:43 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:22:43 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:44 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.713s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:44 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Deleted volume successfully. Jun 19 04:22:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6b71878f-c817-4460-b241-9ecfe16d34e1 tempest-VolumeQuotasAdminTestJSON-621195297 None] Lock "cinder-0c2bddfe-ff6b-46aa-adfd-3b468ac2cbfe-delete_volume" released by "delete_volume" :: held 3.581s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:49 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d" returned: 0 in 6.902s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:49 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c884a4-8866-47c6-8a3b-26da0e384af4]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:49 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 Jun 19 04:22:49 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:50 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76" returned: 0 in 1.035s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:50 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76, size 1024.00 MB, duration 6.90 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:22:50 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Converted 1024.00 MB image at 148.34 MB/s Jun 19 04:22:50 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d is being set with open permissions: ugo+rw Jun 19 04:22:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:50 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d Jun 19 04:22:50 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:51 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d" returned: 0 in 0.728s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-a909a486-d675-462b-8bd5-0618b7f0632d" released by "_copy_volume_from_snapshot" :: held 10.466s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-95249deb-0f0f-4946-b5a5-600f13546135-a909a486-d675-462b-8bd5-0618b7f0632d" released by "_create_volume_from_snapshot" :: held 10.516s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.555s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da5a830f-5148-425b-be44-d1efa6991370) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a909a486-d675-462b-8bd5-0618b7f0632d', 'volume_size': 2, 'snapshot_id': '95249deb-0f0f-4946-b5a5-600f13546135'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c00a94-ccd7-439f-a8df-cef08bb68bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:51 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Volume volume-a909a486-d675-462b-8bd5-0618b7f0632d (a909a486-d675-462b-8bd5-0618b7f0632d): created successfully Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67c00a94-ccd7-439f-a8df-cef08bb68bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (36a3a217-ee9a-4fb4-8954-6f2076b0d3e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-fa070f13-6685-42ca-85f0-6b97105b3735 tempest-VolumesSnapshotTestJSON-904510987 None] Created volume successfully. Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-a909a486-d675-462b-8bd5-0618b7f0632d-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-a909a486-d675-462b-8bd5-0618b7f0632d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-a909a486-d675-462b-8bd5-0618b7f0632d" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-a909a486-d675-462b-8bd5-0618b7f0632d" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f79f7a0-290e-42f2-aa53-cf74752ad43c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:52 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d Jun 19 04:22:52 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:52 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d" returned: 0 in 0.855s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:52 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d Jun 19 04:22:52 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Flow 'volume_create_manager' (ac29d7f2-e139-4f1c-ad37-86d214f17f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0830de13-db54-4ece-8286-80d6bca90741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0830de13-db54-4ece-8286-80d6bca90741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-686600527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77449d7-e070-4f88-8a1c-b66d1c4a11ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b300c425877c4b89b019b904a0f5e6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:53Z,use_quota=True,user_id='95dd2431ac0448a7a169be28f7d110dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4dfb67-0a0b-4f9c-822b-6714210cefed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e4dfb67-0a0b-4f9c-822b-6714210cefed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fd5a12-8a9c-4b54-87e1-371e4859a81f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fd5a12-8a9c-4b54-87e1-371e4859a81f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd77449d7-e070-4f88-8a1c-b66d1c4a11ee', 'volume_name': 'volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603b7fa6-c490-4287-92a2-e733f4aee6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603b7fa6-c490-4287-92a2-e733f4aee6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05516ea0-1aea-4d86-919f-e3b73e6f4cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:53 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Volume d77449d7-e070-4f88-8a1c-b66d1c4a11ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee', 'volume_size': 1} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-686600527',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d77449d7-e070-4f88-8a1c-b66d1c4a11ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b300c425877c4b89b019b904a0f5e6d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:53Z,use_quota=True,user_id='95dd2431ac0448a7a169be28f7d110dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Creating volume d77449d7-e070-4f88-8a1c-b66d1c4a11ee {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:53 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:53 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee 1073741824 Jun 19 04:22:53 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:53 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a909a486-d675-462b-8bd5-0618b7f0632d" returned: 0 in 0.949s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-a909a486-d675-462b-8bd5-0618b7f0632d" released by "delete_volume" :: held 1.863s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Created reservations ['acc9846b-e72d-47c2-a66d-74af3af3f642', '99203f81-0022-47af-9145-72e1e709bbdd', 'e0216389-bfa6-41e7-9345-c391ba985cba', 'fb235b5d-fef3-464f-8fe7-856c3788d6fb'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:53 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:22:53 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-95249deb-0f0f-4946-b5a5-600f13546135-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-95249deb-0f0f-4946-b5a5-600f13546135-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-bfb8c020-c85e-4df0-b83e-9db54134dc76" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-bfb8c020-c85e-4df0-b83e-9db54134dc76" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-95249deb-0f0f-4946-b5a5-600f13546135" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-95249deb-0f0f-4946-b5a5-600f13546135" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Deleting offline snapshot 95249deb-0f0f-4946-b5a5-600f13546135 of volume bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] snapshot_file for this snap is: volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3677fae6-cc75-4637-95b8-2c8b0b2b7a62]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:54 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 Jun 19 04:22:54 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:55 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee 1073741824" returned: 0 in 1.988s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:55 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee Jun 19 04:22:55 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:55 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 2.011s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:55 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:22:55 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Deleted volume successfully. Jun 19 04:22:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-030befeb-08de-4e33-b9ac-fa1a8960bee6 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-a909a486-d675-462b-8bd5-0618b7f0632d-delete_volume" released by "delete_volume" :: held 4.167s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:56 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135" returned: 0 in 1.517s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfb8c020-c85e-4df0-b83e-9db54134dc76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad364d2-1fae-401c-b4e5-ade1704ddf68]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:56 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 Jun 19 04:22:56 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:56 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee" returned: 0 in 0.920s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] <== create_volume: return (3013ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.015s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05516ea0-1aea-4d86-919f-e3b73e6f4cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c18d62-6d0e-4ff0-864c-57b1f1c27559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:56 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Volume volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee (d77449d7-e070-4f88-8a1c-b66d1c4a11ee): created successfully Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89c18d62-6d0e-4ff0-864c-57b1f1c27559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Flow 'volume_create_manager' (ac29d7f2-e139-4f1c-ad37-86d214f17f3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-251fe034-d09f-4cab-978a-68199d5ad8f9 tempest-AttachVolumeNegativeTest-568842932 None] Created volume successfully. Jun 19 04:22:57 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76" returned: 0 in 1.030s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:57 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 Jun 19 04:22:57 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=62,cinder:INSERT=17,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=55,cinder:INSERT=15,cinder:UPDATE=67,cinder:DELETE=8 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Flow 'volume_create_manager' (ec50d6de-d4bc-4cf3-a6d6-7be6e1c5565c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcac0f9a-bcd6-4fa6-980b-27f155f50b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcac0f9a-bcd6-4fa6-980b-27f155f50b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2010862341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c87cb2-ee4b-4889-be74-22c922635556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9665a5f3a74547da811c49720dc4c405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:58Z,use_quota=True,user_id='662b51d388fb447cb931de150dc44444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710a79cc-bb71-40ab-a7f3-086bdc3eb121),volume_type_id=710a79cc-bb71-40ab-a7f3-086bdc3eb121)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3655bf-e55b-4045-9864-bc0bfd3ee86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e3655bf-e55b-4045-9864-bc0bfd3ee86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be1b6b6-df4e-4b08-bbe8-b9c6fa80cc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9be1b6b6-df4e-4b08-bbe8-b9c6fa80cc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47c87cb2-ee4b-4889-be74-22c922635556', 'volume_name': 'volume-47c87cb2-ee4b-4889-be74-22c922635556', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acabc3f7-3451-47b1-89ae-4b738ebb5bc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (acabc3f7-3451-47b1-89ae-4b738ebb5bc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cf9170-5d26-4625-8b76-f340718cb0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:22:57 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Volume 47c87cb2-ee4b-4889-be74-22c922635556: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47c87cb2-ee4b-4889-be74-22c922635556', 'volume_size': 1} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:22:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2010862341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47c87cb2-ee4b-4889-be74-22c922635556,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9665a5f3a74547da811c49720dc4c405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:22:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:22:58Z,use_quota=True,user_id='662b51d388fb447cb931de150dc44444',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(710a79cc-bb71-40ab-a7f3-086bdc3eb121),volume_type_id=710a79cc-bb71-40ab-a7f3-086bdc3eb121)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Creating volume 47c87cb2-ee4b-4889-be74-22c922635556 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:22:57 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:22:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:57 devstack sudo[106024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556 1073741824 Jun 19 04:22:57 devstack sudo[106024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:58 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135" returned: 0 in 1.024s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:58 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135 Jun 19 04:22:58 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:59 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76.95249deb-0f0f-4946-b5a5-600f13546135" returned: 0 in 0.824s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-95249deb-0f0f-4946-b5a5-600f13546135" released by "_delete_snapshot" :: held 4.598s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-bfb8c020-c85e-4df0-b83e-9db54134dc76" released by "delete_snapshot" :: held 4.651s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Created reservations ['a3a779be-0534-48ed-b1d1-57973a645186', '2d646bf4-6e37-46fd-ac47-6ca75897101f', '683d38c2-4eed-4ff6-844b-f488d146245c', '06b4fa17-10df-4abf-9631-775c2d75b17b'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:22:59 devstack sudo[106024]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556 1073741824" returned: 0 in 1.403s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:22:59 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556 Jun 19 04:22:59 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:22:59 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Delete snapshot completed successfully. Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a267cf35-cdaf-4621-9041-8450c96bf71b tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-95249deb-0f0f-4946-b5a5-600f13546135-delete_snapshot" released by "delete_snapshot" :: held 4.870s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-bfb8c020-c85e-4df0-b83e-9db54134dc76-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:22:59 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556" returned: 0 in 0.773s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] <== create_volume: return (2228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:22:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.231s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-bfb8c020-c85e-4df0-b83e-9db54134dc76-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59cf9170-5d26-4625-8b76-f340718cb0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47c87cb2-ee4b-4889-be74-22c922635556', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3af3f8f-fe37-4748-ba53-d6cee15c0903) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:00 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Volume volume-47c87cb2-ee4b-4889-be74-22c922635556 (47c87cb2-ee4b-4889-be74-22c922635556): created successfully Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3af3f8f-fe37-4748-ba53-d6cee15c0903) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Flow 'volume_create_manager' (ec50d6de-d4bc-4cf3-a6d6-7be6e1c5565c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:00 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e3e9f503-4243-44a8-8d26-de85b48875d8 tempest-VolumeTypesAccessTest-1779682889 None] Created volume successfully. Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-bfb8c020-c85e-4df0-b83e-9db54134dc76" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-bfb8c020-c85e-4df0-b83e-9db54134dc76" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d9de1bf-e0f2-4cf8-b351-96c756cd80ca]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:00 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 Jun 19 04:23:00 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Acquiring lock "cinder-47c87cb2-ee4b-4889-be74-22c922635556-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Lock "cinder-47c87cb2-ee4b-4889-be74-22c922635556-delete_volume" acquired by "delete_volume" :: waited 0.158s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Acquiring lock "cinder-quobyte-47c87cb2-ee4b-4889-be74-22c922635556" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Lock "cinder-quobyte-47c87cb2-ee4b-4889-be74-22c922635556" acquired by "delete_volume" :: waited 0.046s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-e9317b9b-a2d9-40fd-a272-2fb8c0792295 req-adb572cc-1efb-48b6-9271-3d345c0a10f6 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-e9317b9b-a2d9-40fd-a272-2fb8c0792295 req-adb572cc-1efb-48b6-9271-3d345c0a10f6 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c052ae-5760-4477-962d-d8753d36907c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c52368-3128-431f-9d36-02c6108c9647]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-e9317b9b-a2d9-40fd-a272-2fb8c0792295 req-adb572cc-1efb-48b6-9271-3d345c0a10f6 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:01 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76" returned: 0 in 1.156s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:01 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76 Jun 19 04:23:01 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:01 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee Jun 19 04:23:01 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:01 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556 Jun 19 04:23:01 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:02 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bfb8c020-c85e-4df0-b83e-9db54134dc76" returned: 0 in 1.242s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-bfb8c020-c85e-4df0-b83e-9db54134dc76" released by "delete_volume" :: held 2.500s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Created reservations ['ffe85ba8-eab5-48a3-b454-7524e08fc516', 'f8b8a57f-5119-4105-8825-cc0f61b72474', '26010d15-0931-4cfc-8ea5-4427553e273b', '4d2a9293-c19b-4710-8873-64a1a738b869'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:02 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-e9317b9b-a2d9-40fd-a272-2fb8c0792295 req-adb572cc-1efb-48b6-9271-3d345c0a10f6 tempest-AttachVolumeNegativeTest-568842932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee" returned: 0 in 1.444s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-e9317b9b-a2d9-40fd-a272-2fb8c0792295 req-adb572cc-1efb-48b6-9271-3d345c0a10f6 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.479s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-e9317b9b-a2d9-40fd-a272-2fb8c0792295 req-adb572cc-1efb-48b6-9271-3d345c0a10f6 tempest-AttachVolumeNegativeTest-568842932 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fc22cf16-cf12-4555-b64f-22c90760d258', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:23:02 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556" returned: 0 in 1.575s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:02 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556 Jun 19 04:23:02 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-e9317b9b-a2d9-40fd-a272-2fb8c0792295 req-adb572cc-1efb-48b6-9271-3d345c0a10f6 tempest-AttachVolumeNegativeTest-568842932 None] attachment_update completed successfully. Jun 19 04:23:02 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:23:02 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:03 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-47c87cb2-ee4b-4889-be74-22c922635556" returned: 0 in 0.919s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Lock "cinder-quobyte-47c87cb2-ee4b-4889-be74-22c922635556" released by "delete_volume" :: held 2.569s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:03 devstack cinder-volume[93769]: WARNING cinder.quota [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-991362007 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-991362007, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:23:03 devstack cinder-volume[93769]: WARNING cinder.quota [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-991362007 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-991362007, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:23:03 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Created reservations ['68fe6a2c-1e31-4566-bbd9-26ce7217e536', '67c16009-4411-4cb9-a2b8-72fbaa90fa5c', '12eca667-80b5-4692-8fa5-44987099beff', '6f13b0a1-eb30-4298-b4b4-91069e5de8f5'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:04 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.102s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:04 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Deleted volume successfully. Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8286c53b-18b2-49d5-8efb-6e5c3241aab1 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-bfb8c020-c85e-4df0-b83e-9db54134dc76-delete_volume" released by "delete_volume" :: held 4.062s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:04 devstack sudo[106147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:23:04 devstack sudo[106147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (ecc5870e-21d5-4aa7-9cc6-eeb746b2c4a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07f055c-b6a8-4db8-902c-d3a2182b9d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b07f055c-b6a8-4db8-902c-d3a2182b9d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-12955735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1e87ce-02b1-4847-a02e-968cd197d130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0211aae816c4d12a1bc615b3f3231c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:05Z,use_quota=True,user_id='990f206d829c4ea085ee39182050b150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef97aed9-6dc7-4f21-ae01-87dc69e9b061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef97aed9-6dc7-4f21-ae01-87dc69e9b061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2055449-bd06-4a47-a85a-27fba8af389f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2055449-bd06-4a47-a85a-27fba8af389f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec1e87ce-02b1-4847-a02e-968cd197d130', 'volume_name': 'volume-ec1e87ce-02b1-4847-a02e-968cd197d130', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bedd41a-3563-419d-aeab-43cdbe1bc22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bedd41a-3563-419d-aeab-43cdbe1bc22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86eace0c-ad39-478e-86a8-bc57d3ef0051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:04 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Volume ec1e87ce-02b1-4847-a02e-968cd197d130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec1e87ce-02b1-4847-a02e-968cd197d130', 'volume_size': 1} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-12955735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec1e87ce-02b1-4847-a02e-968cd197d130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0211aae816c4d12a1bc615b3f3231c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:05Z,use_quota=True,user_id='990f206d829c4ea085ee39182050b150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Creating volume ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:04 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:23:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:04 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 1073741824 Jun 19 04:23:04 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:05 devstack sudo[106147]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.178s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:05 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:05 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Deleted volume successfully. Jun 19 04:23:05 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-393cbe07-7c88-4f82-b0aa-827d9998987b tempest-VolumeTypesAccessTest-1779682889 None] Lock "cinder-47c87cb2-ee4b-4889-be74-22c922635556-delete_volume" released by "delete_volume" :: held 4.175s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:05 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 1073741824" returned: 0 in 1.208s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:06 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 Jun 19 04:23:06 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:06 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130" returned: 0 in 0.841s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86eace0c-ad39-478e-86a8-bc57d3ef0051) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec1e87ce-02b1-4847-a02e-968cd197d130', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5500b21d-8e80-4f78-935b-05e33d7c4609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:06 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Volume volume-ec1e87ce-02b1-4847-a02e-968cd197d130 (ec1e87ce-02b1-4847-a02e-968cd197d130): created successfully Jun 19 04:23:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5500b21d-8e80-4f78-935b-05e33d7c4609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (ecc5870e-21d5-4aa7-9cc6-eeb746b2c4a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:06 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-8cfb56e8-3edf-4e43-ad0a-229fd13d545d tempest-VolumesSnapshotTestJSON-904510987 None] Created volume successfully. Jun 19 04:23:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Creating offline snapshot bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f of volume ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:23:07 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1dce89-e177-4d82-a290-b76783ddc945]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:08 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 Jun 19 04:23:08 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:09 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130" returned: 0 in 1.048s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:09 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f 1G Jun 19 04:23:09 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:10 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f 1G" returned: 0 in 0.986s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec1e87ce-02b1-4847-a02e-968cd197d130 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:10 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec1e87ce-02b1-4847-a02e-968cd197d130 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f Jun 19 04:23:10 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:10 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-ab13b70c-c240-4de0-ad03-e1f3e7f9a3db req-1b8987f9-48c8-49ff-a0d5-80d985e799c0 tempest-AttachVolumeNegativeTest-568842932 None] Terminate volume connection completed successfully. Jun 19 04:23:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-ab13b70c-c240-4de0-ad03-e1f3e7f9a3db req-1b8987f9-48c8-49ff-a0d5-80d985e799c0 tempest-AttachVolumeNegativeTest-568842932 None] Deleting attachment fc22cf16-cf12-4555-b64f-22c90760d258. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:23:10 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ec1e87ce-02b1-4847-a02e-968cd197d130 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f" returned: 0 in 0.800s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:10 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f is being set with open permissions: ugo+rw Jun 19 04:23:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:10 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f Jun 19 04:23:10 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:11 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f" returned: 0 in 0.661s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:11 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.info Jun 19 04:23:11 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:12 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.info" returned: 0 in 0.658s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:12 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.info is being set with open permissions: ugo+rw Jun 19 04:23:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:12 devstack sudo[106591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.info Jun 19 04:23:12 devstack sudo[106591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:12 devstack sudo[106591]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.info" returned: 0 in 0.790s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.057s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:13 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5ff84518-75da-4031-8ffb-b16aff86b4ab tempest-VolumesSnapshotTestJSON-904510987 None] Create snapshot completed successfully Jun 19 04:23:13 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:13 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (ae19c9a1-d5ac-4773-a97f-d8d98b5c6a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:13 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c784fced-b875-4492-a71b-dcf9136dc18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:13 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c784fced-b875-4492-a71b-dcf9136dc18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1319244763',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c7fa39-b5ca-4937-96a8-5749654aef76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0211aae816c4d12a1bc615b3f3231c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:14Z,use_quota=True,user_id='990f206d829c4ea085ee39182050b150',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c761d1-9e7a-48a1-b681-e4986680b1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c761d1-9e7a-48a1-b681-e4986680b1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8c2937-7843-48ce-a5d3-4d0a1db926f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f8c2937-7843-48ce-a5d3-4d0a1db926f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '71c7fa39-b5ca-4937-96a8-5749654aef76', 'volume_name': 'volume-71c7fa39-b5ca-4937-96a8-5749654aef76', 'volume_size': 1, 'snapshot_id': 'bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c20e3a8-0293-411d-a5fe-e5af47ea0fc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c20e3a8-0293-411d-a5fe-e5af47ea0fc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498b2ff3-deaf-4c99-9566-0d8550df43b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:14 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Volume 71c7fa39-b5ca-4937-96a8-5749654aef76: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-71c7fa39-b5ca-4937-96a8-5749654aef76', 'volume_size': 1, 'snapshot_id': 'bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f'} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f-71c7fa39-b5ca-4937-96a8-5749654aef76" by "_create_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f-71c7fa39-b5ca-4937-96a8-5749654aef76" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Creating volume 71c7fa39-b5ca-4937-96a8-5749654aef76 from snapshot bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f {{(pid=93769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-71c7fa39-b5ca-4937-96a8-5749654aef76" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-71c7fa39-b5ca-4937-96a8-5749654aef76" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] snapshot: bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f, volume: 71c7fa39-b5ca-4937-96a8-5749654aef76, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbf29fb0-219c-4e9e-8471-b5fc4f831fab]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:14 devstack sudo[106635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f Jun 19 04:23:14 devstack sudo[106635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:15 devstack sudo[106635]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f" returned: 0 in 0.949s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec1e87ce-02b1-4847-a02e-968cd197d130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:23:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:23:15 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[923494b9-dd21-439e-97c7-15533d94ae99]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:15 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 Jun 19 04:23:15 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:16 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130" returned: 0 in 1.136s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:16 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:23:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:16 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 Jun 19 04:23:16 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:22 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76" returned: 0 in 6.572s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:22 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8e091c5-7c9c-4faf-ac78-729238dd752e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:23 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 Jun 19 04:23:23 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:23 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130" returned: 0 in 0.996s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:23 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130, size 1024.00 MB, duration 6.57 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:23:23 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Converted 1024.00 MB image at 155.79 MB/s Jun 19 04:23:23 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 is being set with open permissions: ugo+rw Jun 19 04:23:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:24 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 Jun 19 04:23:24 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:24 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=27,cinder:INSERT=10,cinder:UPDATE=34 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:23:24 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=35,cinder:INSERT=5,cinder:UPDATE=27,cinder:DELETE=5 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:23:24 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76" returned: 0 in 0.905s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-71c7fa39-b5ca-4937-96a8-5749654aef76" released by "_copy_volume_from_snapshot" :: held 10.712s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f-71c7fa39-b5ca-4937-96a8-5749654aef76" released by "_create_volume_from_snapshot" :: held 10.758s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.788s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498b2ff3-deaf-4c99-9566-0d8550df43b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c7fa39-b5ca-4937-96a8-5749654aef76', 'volume_size': 1, 'snapshot_id': 'bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598ea2f6-12a6-4ab9-b5cd-9da3ef17d10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:25 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Volume volume-71c7fa39-b5ca-4937-96a8-5749654aef76 (71c7fa39-b5ca-4937-96a8-5749654aef76): created successfully Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (598ea2f6-12a6-4ab9-b5cd-9da3ef17d10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Flow 'volume_create_manager' (ae19c9a1-d5ac-4773-a97f-d8d98b5c6a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-346214b0-50c6-4ebf-ac8e-796f24fdeb25 tempest-VolumesSnapshotTestJSON-904510987 None] Created volume successfully. Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-71c7fa39-b5ca-4937-96a8-5749654aef76-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-71c7fa39-b5ca-4937-96a8-5749654aef76-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-71c7fa39-b5ca-4937-96a8-5749654aef76" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-71c7fa39-b5ca-4937-96a8-5749654aef76" acquired by "delete_volume" :: waited 0.033s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "cinder-d77449d7-e070-4f88-8a1c-b66d1c4a11ee-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-d77449d7-e070-4f88-8a1c-b66d1c4a11ee-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd023af0-cbe3-402c-9bc2-532f776fcc69]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "cinder-quobyte-d77449d7-e070-4f88-8a1c-b66d1c4a11ee" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-quobyte-d77449d7-e070-4f88-8a1c-b66d1c4a11ee" acquired by "delete_volume" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[812b7faa-82d1-4d27-a32c-abbbf0ce5b4a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:25 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 Jun 19 04:23:25 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:25 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee Jun 19 04:23:25 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-b4540fa9-938b-46ab-b060-7b46159dfa6d req-a7295934-253d-4f90-8772-fe7b81bb4249 tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-b4540fa9-938b-46ab-b060-7b46159dfa6d req-a7295934-253d-4f90-8772-fe7b81bb4249 tempest-TestStampPattern-688608864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:26 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[07de4ef1-6322-421f-b7b2-fc37af74cfba]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-b4540fa9-938b-46ab-b060-7b46159dfa6d req-a7295934-253d-4f90-8772-fe7b81bb4249 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:26 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 Jun 19 04:23:26 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:26 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76" returned: 0 in 1.072s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:26 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76 Jun 19 04:23:26 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:26 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee" returned: 0 in 1.177s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:26 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee Jun 19 04:23:26 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-b4540fa9-938b-46ab-b060-7b46159dfa6d req-a7295934-253d-4f90-8772-fe7b81bb4249 tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676" returned: 0 in 1.065s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:27 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-b4540fa9-938b-46ab-b060-7b46159dfa6d req-a7295934-253d-4f90-8772-fe7b81bb4249 tempest-TestStampPattern-688608864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.096s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-b4540fa9-938b-46ab-b060-7b46159dfa6d req-a7295934-253d-4f90-8772-fe7b81bb4249 tempest-TestStampPattern-688608864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-fc6eba0f-f60b-4e58-8658-41ee0042e676', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6cd33260-3daf-4229-b009-9e204f5000d1', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:23:27 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-b4540fa9-938b-46ab-b060-7b46159dfa6d req-a7295934-253d-4f90-8772-fe7b81bb4249 tempest-TestStampPattern-688608864 None] attachment_update completed successfully. Jun 19 04:23:27 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-71c7fa39-b5ca-4937-96a8-5749654aef76" returned: 0 in 0.850s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-71c7fa39-b5ca-4937-96a8-5749654aef76" released by "delete_volume" :: held 2.007s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Created reservations ['b7cefd25-c120-4f6d-8069-28ca8cacf6ae', '0029810f-21c3-44ca-b253-54a593a0048a', 'ce0980ad-0031-4a41-840d-e0d1718c1a45', '1f72ce90-79f3-4e67-94af-628db99d24fb'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:27 devstack sudo[106709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:23:27 devstack sudo[106709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:27 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d77449d7-e070-4f88-8a1c-b66d1c4a11ee" returned: 0 in 0.899s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-quobyte-d77449d7-e070-4f88-8a1c-b66d1c4a11ee" released by "delete_volume" :: held 2.156s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Created reservations ['98da9acd-257f-42e8-9362-38e24efaf256', '3b6b8d09-0f72-46d7-8e98-2a09fbd16f21', 'c7739321-5592-4848-9942-3b8285163759', '0692e650-c09a-4101-9fbc-fd4593e4c8e9'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:28 devstack sudo[106779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:23:28 devstack sudo[106779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-ec1e87ce-02b1-4847-a02e-968cd197d130" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-ec1e87ce-02b1-4847-a02e-968cd197d130" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Deleting offline snapshot bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f of volume ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] snapshot_file for this snap is: volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd26040-816c-4789-bb81-093b7d8ab2cd]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:28 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f Jun 19 04:23:28 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:28 devstack sudo[106709]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.871s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Deleted volume successfully. Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f76c59b2-70ec-41c8-a9d0-d73710bafce0 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-71c7fa39-b5ca-4937-96a8-5749654aef76-delete_volume" released by "delete_volume" :: held 3.145s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:28 devstack sudo[106779]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.943s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Deleted volume successfully. Jun 19 04:23:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cdebb080-430f-42a0-823f-0942c5df30e3 tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-d77449d7-e070-4f88-8a1c-b66d1c4a11ee-delete_volume" released by "delete_volume" :: held 3.473s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "cinder-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "cinder-quobyte-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-quobyte-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad9767c5-23f5-4fc0-ba80-d56c44948c51]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:29 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 Jun 19 04:23:29 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:29 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f" returned: 0 in 1.199s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ec1e87ce-02b1-4847-a02e-968cd197d130(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[696301ab-58ad-46cb-b59b-38c3f2017fd2]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:29 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 Jun 19 04:23:29 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:30 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7" returned: 0 in 0.809s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:30 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7 Jun 19 04:23:30 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:30 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:30 devstack sudo[107119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f Jun 19 04:23:30 devstack sudo[107119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:30 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7" returned: 0 in 0.786s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-quobyte-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7" released by "delete_volume" :: held 1.661s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:30 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Created reservations ['497aa7c1-1053-4ed6-b2d0-b143f8f1b0a8', '8dd9f18f-0114-4b96-85e0-5c83aca88786', 'e1c31eff-99f7-4855-aede-52dcb5c72d6a', '5eb4c7a0-9169-4a7e-a751-040fcbf9df60'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:31 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:23:31 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:31 devstack sudo[107119]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f" returned: 0 in 1.103s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:31 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f Jun 19 04:23:31 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:31 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.787s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:31 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Deleted volume successfully. Jun 19 04:23:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871d5c48-f65b-48dd-89c8-de2639c3ce1d tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-d79cf8f3-9c2d-4cf6-b8aa-99ccc4e978d7-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:32 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130.bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f" returned: 0 in 0.766s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f" released by "_delete_snapshot" :: held 4.040s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-ec1e87ce-02b1-4847-a02e-968cd197d130" released by "delete_snapshot" :: held 4.070s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "cinder-b51794c0-a47a-4acb-b3a6-4f9912832f27-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-b51794c0-a47a-4acb-b3a6-4f9912832f27-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "cinder-quobyte-b51794c0-a47a-4acb-b3a6-4f9912832f27" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-quobyte-b51794c0-a47a-4acb-b3a6-4f9912832f27" acquired by "delete_volume" :: waited 0.063s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Created reservations ['05efaa74-b7da-41c9-b357-2c15cb215d09', '20808401-b2a7-4d8a-81c7-7b4423bd248e', '35847922-63b5-4157-945c-4815a03adc49', '460acca1-dafb-4a18-8f30-f78f2ab43828'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5fd8059-dc97-41ae-b49e-e0d6e184bded]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:32 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Delete snapshot completed successfully. Jun 19 04:23:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-936aa445-5555-4126-a771-98a6bf9fc9c7 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-bc4bbd9b-697e-4bdb-8f36-8c44fc5f2b1f-delete_snapshot" released by "delete_snapshot" :: held 4.508s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:32 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 Jun 19 04:23:32 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:33 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27" returned: 0 in 1.022s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:33 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27 Jun 19 04:23:33 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-ec1e87ce-02b1-4847-a02e-968cd197d130-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-ec1e87ce-02b1-4847-a02e-968cd197d130-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-ec1e87ce-02b1-4847-a02e-968cd197d130" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-ec1e87ce-02b1-4847-a02e-968cd197d130" acquired by "delete_volume" :: waited 0.028s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:33 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd114f6c-5c48-47c6-b050-20afc4d1d170]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:34 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 Jun 19 04:23:34 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:34 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b51794c0-a47a-4acb-b3a6-4f9912832f27" returned: 0 in 1.069s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-quobyte-b51794c0-a47a-4acb-b3a6-4f9912832f27" released by "delete_volume" :: held 2.171s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:34 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Created reservations ['7b4cc069-a075-4db4-abd6-fa2c679dce06', '3dd5d1a8-b8de-4782-bfbe-75908b6239af', 'a39fd659-db1e-454a-9ddf-264bc19987c9', '28507676-ac54-4d58-b5d0-73b283f39a43'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:34 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:23:34 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:35 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130" returned: 0 in 1.234s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:35 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130 Jun 19 04:23:35 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:35 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.807s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:35 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:35 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Deleted volume successfully. Jun 19 04:23:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2453f38e-2c15-4e6c-8d09-c1e20ffc4b6a tempest-AttachVolumeNegativeTest-568842932 None] Lock "cinder-b51794c0-a47a-4acb-b3a6-4f9912832f27-delete_volume" released by "delete_volume" :: held 3.551s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:35 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ec1e87ce-02b1-4847-a02e-968cd197d130" returned: 0 in 0.875s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-ec1e87ce-02b1-4847-a02e-968cd197d130" released by "delete_volume" :: held 2.196s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Created reservations ['9301b3cc-832e-4285-946b-2c9a68a920c6', '08f82ccf-668f-405a-82db-f6468d46975a', '46c3a76d-ac0b-4e3c-9f3b-a288b67408aa', 'e269c18d-a40d-4dfc-a76e-81928f12af81'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:36 devstack sudo[107182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:23:36 devstack sudo[107182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:36 devstack sudo[107182]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.712s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Deleted volume successfully. Jun 19 04:23:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-334376c6-5cb2-4f7e-895a-c0f9c5ca3064 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-ec1e87ce-02b1-4847-a02e-968cd197d130-delete_volume" released by "delete_volume" :: held 3.230s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-09ad0928-409c-49f6-8d2d-03081af7f750-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-09ad0928-409c-49f6-8d2d-03081af7f750-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "cinder-quobyte-09ad0928-409c-49f6-8d2d-03081af7f750" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:23:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-09ad0928-409c-49f6-8d2d-03081af7f750" acquired by "delete_volume" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:23:37 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1285399b-fddf-4314-b989-affde6ee44bd]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-a96b8ae7-bf37-4300-ab67-8810d6df6938 req-d7d53eb8-c99b-42c2-adcb-95b01f283982 tempest-TestStampPattern-688608864 None] Terminate volume connection completed successfully. Jun 19 04:23:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-a96b8ae7-bf37-4300-ab67-8810d6df6938 req-d7d53eb8-c99b-42c2-adcb-95b01f283982 tempest-TestStampPattern-688608864 None] Deleting attachment 6cd33260-3daf-4229-b009-9e204f5000d1. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:23:37 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 Jun 19 04:23:37 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:38 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750" returned: 0 in 1.049s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:38 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750 Jun 19 04:23:38 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:39 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-09ad0928-409c-49f6-8d2d-03081af7f750" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-quobyte-09ad0928-409c-49f6-8d2d-03081af7f750" released by "delete_volume" :: held 1.933s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Created reservations ['c6c4ac62-1293-47c4-90c0-78fdc4f18641', 'e6df7c77-8eda-4279-a9e2-38700e15bb0d', '8bd72a75-9dd6-468f-b0a3-dcfee2fffcb5', '3167c29e-221b-44af-8a10-fa9c5f083714'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:39 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:23:39 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Creating offline snapshot 29d0fa3e-ea2b-403a-a093-48f2b7bc8296 of volume fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e405b0-3594-4180-94dd-61f548de49fe]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:39 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 Jun 19 04:23:39 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:40 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.019s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:40 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Deleted volume successfully. Jun 19 04:23:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a40c22-c292-4477-b468-0fcf8fc99542 tempest-VolumesSnapshotTestJSON-904510987 None] Lock "cinder-09ad0928-409c-49f6-8d2d-03081af7f750-delete_volume" released by "delete_volume" :: held 3.403s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:23:40 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676" returned: 0 in 1.062s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:40 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 1G Jun 19 04:23:40 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:23:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:41 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:23:41 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:42 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 1G" returned: 0 in 1.209s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:42 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 Jun 19 04:23:42 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:42 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.908s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:23:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:23:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:23:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:23:43 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296" returned: 0 in 0.981s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:43 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 is being set with open permissions: ugo+rw Jun 19 04:23:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:43 devstack sudo[107254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 Jun 19 04:23:43 devstack sudo[107254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:43 devstack sudo[107254]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296" returned: 0 in 0.778s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:44 devstack sudo[107259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.info Jun 19 04:23:44 devstack sudo[107259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:44 devstack sudo[107259]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.info" returned: 0 in 0.886s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:44 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.info is being set with open permissions: ugo+rw Jun 19 04:23:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:44 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.info Jun 19 04:23:44 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:46 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.info" returned: 0 in 1.301s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.494s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-52c2fabc-851d-484b-9cb3-42dfe9336d0b tempest-TestStampPattern-688608864 None] Create snapshot completed successfully Jun 19 04:23:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-110cf38a-b1d3-423f-b36f-cfc3e27a38ae tempest-GroupSnapshotsTest-879368004 None] Group tempest-GroupSnapshotsTest-Group-1209554810: creating Jun 19 04:23:48 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-110cf38a-b1d3-423f-b36f-cfc3e27a38ae tempest-GroupSnapshotsTest-879368004 None] Group tempest-GroupSnapshotsTest-Group-1209554810: created successfully Jun 19 04:23:48 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-110cf38a-b1d3-423f-b36f-cfc3e27a38ae tempest-GroupSnapshotsTest-879368004 None] Create group completed successfully. Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Flow 'volume_create_manager' (bbfec9dc-3404-4796-840d-354278839fea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cc3849-a695-4270-b11d-06042f89c2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0cc3849-a695-4270-b11d-06042f89c2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1933999123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca13cc564a734bd6af88c342d68d8d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:49Z,use_quota=True,user_id='d325ee8a9c7b44ebbc926a7dbc4172a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f510bf-0a40-438f-802c-84f28a55eed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f510bf-0a40-438f-802c-84f28a55eed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0425dc8-5e71-4378-bded-62bb207762ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0425dc8-5e71-4378-bded-62bb207762ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b', 'volume_name': 'volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b', 'volume_size': 2}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbdc4c8-4260-43a4-9015-c877d50b66f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfbdc4c8-4260-43a4-9015-c877d50b66f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b170953d-f393-4f3d-ae51-ab5b639e09cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Volume 727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b', 'volume_size': 2} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1933999123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca13cc564a734bd6af88c342d68d8d09',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:49Z,use_quota=True,user_id='d325ee8a9c7b44ebbc926a7dbc4172a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Creating volume 727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:49 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b 2147483648 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:49 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b 2147483648 Jun 19 04:23:49 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Flow 'volume_create_manager' (1f91864b-b8ec-4aba-b2c8-b72295079154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa512dd0-c5a9-4626-a1bf-1a66188df1be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa512dd0-c5a9-4626-a1bf-1a66188df1be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131934737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f1c79db-8a1d-46ba-9836-cf6ab1cf2e67,host='devstack@QuobyteHD#QuobyteHD',id=6658b386-0cec-428c-862b-634aa5e5b1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40faa17fd0a74dbb82aa69f99ef49d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:50Z,use_quota=True,user_id='e1b40877d0cf47468f05ccc34aad8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a329824-4d29-4e05-a716-d7ced1dd65d5),volume_type_id=2a329824-4d29-4e05-a716-d7ced1dd65d5)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb64d29a-7479-4bdf-84d9-ec5a136f7bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb64d29a-7479-4bdf-84d9-ec5a136f7bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d545903-9683-4f0a-9f17-b02f2c25997e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d545903-9683-4f0a-9f17-b02f2c25997e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6658b386-0cec-428c-862b-634aa5e5b1c1', 'volume_name': 'volume-6658b386-0cec-428c-862b-634aa5e5b1c1', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45636cb-adf6-4381-81d2-21a7b243b7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45636cb-adf6-4381-81d2-21a7b243b7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b190c04f-1319-44be-91c8-2f9f4c073a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:49 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Volume 6658b386-0cec-428c-862b-634aa5e5b1c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6658b386-0cec-428c-862b-634aa5e5b1c1', 'volume_size': 1} Jun 19 04:23:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:50 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b 2147483648" returned: 0 in 1.073s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:50 devstack sudo[107292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b Jun 19 04:23:50 devstack sudo[107292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:50 devstack sudo[107292]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" returned: 0 in 0.635s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.748s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.065s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5f1c79db-8a1d-46ba-9836-cf6ab1cf2e67,created_at=2026-06-19T02:23:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-131934737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5f1c79db-8a1d-46ba-9836-cf6ab1cf2e67,host='devstack@QuobyteHD#QuobyteHD',id=6658b386-0cec-428c-862b-634aa5e5b1c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40faa17fd0a74dbb82aa69f99ef49d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:50Z,use_quota=True,user_id='e1b40877d0cf47468f05ccc34aad8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2a329824-4d29-4e05-a716-d7ced1dd65d5),volume_type_id=2a329824-4d29-4e05-a716-d7ced1dd65d5)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Creating volume 6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:23:50 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:50 devstack sudo[107298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 1073741824 Jun 19 04:23:50 devstack sudo[107298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b170953d-f393-4f3d-ae51-ab5b639e09cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b', 'volume_size': 2}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c999aca2-2de8-4de8-a610-69d4b966d509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:50 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Volume volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b (727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b): created successfully Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c999aca2-2de8-4de8-a610-69d4b966d509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Flow 'volume_create_manager' (bbfec9dc-3404-4796-840d-354278839fea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:50 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-bee54f6a-f1be-45fd-86bf-e0d28bbb5e7f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Created volume successfully. Jun 19 04:23:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:51 devstack sudo[107298]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 1073741824" returned: 0 in 0.902s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:51 devstack sudo[107312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 Jun 19 04:23:51 devstack sudo[107312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:52 devstack sudo[107312]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1" returned: 0 in 0.811s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] <== create_volume: return (1785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.789s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.337s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Creating offline snapshot b5255c45-c670-4ea2-a5d5-262a8b7eccdd of volume 727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b190c04f-1319-44be-91c8-2f9f4c073a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6658b386-0cec-428c-862b-634aa5e5b1c1', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63ec435-5056-43bf-963c-645e72aef0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[89f1b727-1032-48d7-8734-185ac0c7ebd2]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:52 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Volume volume-6658b386-0cec-428c-862b-634aa5e5b1c1 (6658b386-0cec-428c-862b-634aa5e5b1c1): created successfully Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63ec435-5056-43bf-963c-645e72aef0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Flow 'volume_create_manager' (1f91864b-b8ec-4aba-b2c8-b72295079154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:52 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d87315b5-237f-4638-8d37-972854eeaa1e tempest-GroupSnapshotsTest-879368004 None] Created volume successfully. Jun 19 04:23:52 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b Jun 19 04:23:52 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:54 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] GroupSnapshot fc92c26c-045d-42be-8da8-490b614ca903: creating. Jun 19 04:23:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Group snapshot fc92c26c-045d-42be-8da8-490b614ca903: creating. {{(pid=93769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:23:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:54 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" returned: 0 in 1.401s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd 2G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:54 devstack sudo[107431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd 2G Jun 19 04:23:54 devstack sudo[107431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:55 devstack sudo[107431]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd 2G" returned: 0 in 1.023s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:55 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd Jun 19 04:23:55 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:56 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd" returned: 0 in 0.927s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:56 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd is being set with open permissions: ugo+rw Jun 19 04:23:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:56 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd Jun 19 04:23:56 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:57 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd" returned: 0 in 0.964s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:57 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.info Jun 19 04:23:57 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (4f4962cb-ff2e-41fb-b6a8-b13560bb5b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636db859-ef02-4761-8fec-43541e3127dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636db859-ef02-4761-8fec-43541e3127dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1843736057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d313e48-7c74-434f-8b9c-ad84b4de1b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:58Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c4afec-2b2e-4343-a736-61bd52d44487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1c4afec-2b2e-4343-a736-61bd52d44487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a563f6ef-8a62-49ee-8267-5c4909354671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a563f6ef-8a62-49ee-8267-5c4909354671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d313e48-7c74-434f-8b9c-ad84b4de1b77', 'volume_name': 'volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c12a697-34d9-45a4-8d08-79c35791c76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c12a697-34d9-45a4-8d08-79c35791c76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f158ae12-4b8c-4c94-b39e-4da9804f46c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:57 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Volume 5d313e48-7c74-434f-8b9c-ad84b4de1b77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77', 'volume_size': 1} Jun 19 04:23:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:58 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.info" returned: 0 in 0.992s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:58 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.info is being set with open permissions: ugo+rw Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:58 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.info Jun 19 04:23:58 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Flow 'volume_create_manager' (56ceb1c4-9fc9-4213-87f6-955b6f1f8418) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0d9f13-f13d-4373-892a-30d57c96d1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb0d9f13-f13d-4373-892a-30d57c96d1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-2019335065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f92fee3-1700-4656-a378-7db3d344a834,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='322abf8a3ec8460699ad582769911053',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=29d0fa3e-ea2b-403a-a093-48f2b7bc8296,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:59Z,use_quota=True,user_id='3496981fed3341c2a8ee855c94fabc24',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f734fb63-150f-4b21-9917-31d4f1b06ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f734fb63-150f-4b21-9917-31d4f1b06ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bcbc43-41f6-4632-9e2a-389a7e73b0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22bcbc43-41f6-4632-9e2a-389a7e73b0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2f92fee3-1700-4656-a378-7db3d344a834', 'volume_name': 'volume-2f92fee3-1700-4656-a378-7db3d344a834', 'volume_size': 1, 'snapshot_id': '29d0fa3e-ea2b-403a-a093-48f2b7bc8296'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a69f8e-0862-4041-a3e3-aa492ccb78a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41a69f8e-0862-4041-a3e3-aa492ccb78a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22c8c20-9f82-4f01-a05f-d5505caecda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:23:58 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Volume 2f92fee3-1700-4656-a378-7db3d344a834: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2f92fee3-1700-4656-a378-7db3d344a834', 'volume_size': 1, 'snapshot_id': '29d0fa3e-ea2b-403a-a093-48f2b7bc8296'} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:23:58 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.info" returned: 0 in 0.773s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.228s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.804s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Creating offline snapshot d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 of volume 6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:23:58 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-77384e46-c793-4fbc-af33-3961902b31a2 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Create snapshot completed successfully Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f983787-4682-46a9-bbc3-e590cdd29bc0]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:23:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:59 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 Jun 19 04:23:59 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:59 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Jun 19 04:23:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1" returned: 0 in 0.944s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:23:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:23:59 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 1G Jun 19 04:23:59 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:23:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Acquiring lock "cinder-b5255c45-c670-4ea2-a5d5-262a8b7eccdd-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-b5255c45-c670-4ea2-a5d5-262a8b7eccdd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Acquiring lock "cinder-quobyte-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-quobyte-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Acquiring lock "cinder-quobyte-b5255c45-c670-4ea2-a5d5-262a8b7eccdd" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-quobyte-b5255c45-c670-4ea2-a5d5-262a8b7eccdd" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Deleting offline snapshot b5255c45-c670-4ea2-a5d5-262a8b7eccdd of volume 727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] snapshot_file for this snap is: volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5392efd-2832-44cb-a060-813b854b80b9]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:00 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd Jun 19 04:24:00 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:00 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 1G" returned: 0 in 1.060s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6658b386-0cec-428c-862b-634aa5e5b1c1 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:01 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6658b386-0cec-428c-862b-634aa5e5b1c1 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 Jun 19 04:24:01 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:01 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd" returned: 0 in 0.978s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:01 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef817aa9-c074-4662-826b-344a27730e8a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:01 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b Jun 19 04:24:01 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:01 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6658b386-0cec-428c-862b-634aa5e5b1c1 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7" returned: 0 in 0.750s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:01 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:24:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:01 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 Jun 19 04:24:01 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:02 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" returned: 0 in 0.909s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:02 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd Jun 19 04:24:02 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:02 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7" returned: 0 in 0.683s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:02 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.info Jun 19 04:24:02 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:02 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd" returned: 0 in 0.779s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:02 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd Jun 19 04:24:02 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:03 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.info" returned: 0 in 0.780s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:03 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:03 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.info Jun 19 04:24:03 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:03 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b.b5255c45-c670-4ea2-a5d5-262a8b7eccdd" returned: 0 in 0.668s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-quobyte-b5255c45-c670-4ea2-a5d5-262a8b7eccdd" released by "_delete_snapshot" :: held 3.465s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-quobyte-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" released by "delete_snapshot" :: held 3.496s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Created reservations ['a6b38c87-f415-4d25-bf73-cb3150e7ab83', 'dc1cc8cf-a89f-4895-b29f-a235142b17fe', '02ff8615-8812-45d3-a9d2-e539890dadc6', '0d23006e-d430-47fa-b70c-f9b0d7082f17'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:03 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Delete snapshot completed successfully. Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b898fd4c-135e-4f7f-b707-37c4fadc56a5 tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-b5255c45-c670-4ea2-a5d5-262a8b7eccdd-delete_snapshot" released by "delete_snapshot" :: held 3.659s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:03 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.info" returned: 0 in 0.685s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.071s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.173s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1843736057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d313e48-7c74-434f-8b9c-ad84b4de1b77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:23:58Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Creating volume 5d313e48-7c74-434f-8b9c-ad84b4de1b77 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:04 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:04 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 1073741824 Jun 19 04:24:04 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:04 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-85d79387-42a9-4e59-8a17-057700450127 tempest-GroupSnapshotsTest-879368004 None] group_snapshot fc92c26c-045d-42be-8da8-490b614ca903: created successfully Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Acquiring lock "cinder-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Acquiring lock "cinder-quobyte-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-quobyte-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[191a559b-3b4e-44b1-82af-75b87fe1205a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:04 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b Jun 19 04:24:04 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:05 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 1073741824" returned: 0 in 1.224s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:05 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 Jun 19 04:24:05 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:06 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" returned: 0 in 1.507s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:06 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b Jun 19 04:24:06 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:06 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77" returned: 0 in 1.664s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] <== create_volume: return (2947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.950s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.097s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:06 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Acquiring lock "cinder-quobyte-29d0fa3e-ea2b-403a-a093-48f2b7bc8296-2f92fee3-1700-4656-a378-7db3d344a834" by "_create_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f158ae12-4b8c-4c94-b39e-4da9804f46c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f91ee5-1550-4f37-a7c3-57fa17a61486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-29d0fa3e-ea2b-403a-a093-48f2b7bc8296-2f92fee3-1700-4656-a378-7db3d344a834" acquired by "_create_volume_from_snapshot" :: waited 0.073s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Creating volume 2f92fee3-1700-4656-a378-7db3d344a834 from snapshot 29d0fa3e-ea2b-403a-a093-48f2b7bc8296 {{(pid=93769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Acquiring lock "cinder-quobyte-2f92fee3-1700-4656-a378-7db3d344a834" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:07 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Volume volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 (5d313e48-7c74-434f-8b9c-ad84b4de1b77): created successfully Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38f91ee5-1550-4f37-a7c3-57fa17a61486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (4f4962cb-ff2e-41fb-b6a8-b13560bb5b8e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-2f92fee3-1700-4656-a378-7db3d344a834" acquired by "_copy_volume_from_snapshot" :: waited 0.081s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] snapshot: 29d0fa3e-ea2b-403a-a093-48f2b7bc8296, volume: 2f92fee3-1700-4656-a378-7db3d344a834, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:24:07 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-81ed7f94-2da3-4643-b7f2-bc85a66823c6 tempest-VolumesActionsTest-1804869796 None] Created volume successfully. Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34dacd1-4803-4aa2-af39-69d13bfdde04]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-29b9c256-cf4c-4ebd-ad39-d8b7129b3ab8 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77" by "attach_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:07 devstack sudo[107542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 Jun 19 04:24:07 devstack sudo[107542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-29b9c256-cf4c-4ebd-ad39-d8b7129b3ab8 tempest-VolumesActionsTest-1804869796 None] Lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77" acquired by "attach_volume" :: waited 0.069s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:07 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-29b9c256-cf4c-4ebd-ad39-d8b7129b3ab8 tempest-VolumesActionsTest-1804869796 None] Attaching volume 5d313e48-7c74-434f-8b9c-ad84b4de1b77 to instance 78241f85-63f6-40a2-9d6a-b6b021c2fbd0 at mountpoint /dev/vdb on host None. Jun 19 04:24:07 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-29b9c256-cf4c-4ebd-ad39-d8b7129b3ab8 tempest-VolumesActionsTest-1804869796 None] Attach volume completed successfully. Jun 19 04:24:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-29b9c256-cf4c-4ebd-ad39-d8b7129b3ab8 tempest-VolumesActionsTest-1804869796 None] Lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77" released by "attach_volume" :: held 0.345s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:08 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" returned: 0 in 1.870s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-quobyte-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b" released by "delete_volume" :: held 3.504s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Created reservations ['d930c524-e787-4484-b401-5fbe43b402a9', '890185ec-0efb-4af2-91f8-b8374b60c9c7', 'e3984e8d-fa38-43af-a8ab-1eca39a58086', 'a451d22f-7448-4bf5-aa86-c50db1854be8'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:08 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:24:08 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:08 devstack sudo[107542]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296" returned: 0 in 1.240s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc6eba0f-f60b-4e58-8658-41ee0042e676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[65c7c738-639f-4eab-9168-3e6a7d0c7c0b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:08 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 Jun 19 04:24:08 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:08 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e6d7dd05-830a-4fba-ad54-b61969adf562 tempest-VolumesActionsTest-520657303 None] Terminate volume connection completed successfully. Jun 19 04:24:09 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e6d7dd05-830a-4fba-ad54-b61969adf562 tempest-VolumesActionsTest-520657303 None] Acquiring lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77-detach_volume" by "detach_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.997s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:09 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:09 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Deleted volume successfully. Jun 19 04:24:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e6d7dd05-830a-4fba-ad54-b61969adf562 tempest-VolumesActionsTest-520657303 None] Lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77-detach_volume" acquired by "detach_volume" :: waited 0.042s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6289a4a-7872-46cd-828c-a68ad3c12f1f tempest-VolumesSnapshotNegativeTestJSON-440469720 None] Lock "cinder-727a4f36-d2ca-4af6-ae2d-be0a0d17fc7b-delete_volume" released by "delete_volume" :: held 4.940s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:09 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e6d7dd05-830a-4fba-ad54-b61969adf562 tempest-VolumesActionsTest-520657303 None] Detaching volume 5d313e48-7c74-434f-8b9c-ad84b4de1b77 from instance 78241f85-63f6-40a2-9d6a-b6b021c2fbd0. Jun 19 04:24:09 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e6d7dd05-830a-4fba-ad54-b61969adf562 tempest-VolumesActionsTest-520657303 None] Detach volume completed successfully. Jun 19 04:24:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e6d7dd05-830a-4fba-ad54-b61969adf562 tempest-VolumesActionsTest-520657303 None] Lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77-detach_volume" released by "detach_volume" :: held 0.143s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:09 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676" returned: 0 in 1.208s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:09 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:24:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:09 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 Jun 19 04:24:09 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f89e8956-57b6-4431-a093-84ea82ef6cfa tempest-VolumesActionsTest-1804869796 None] Acquiring lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77-detach_volume" by "detach_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f89e8956-57b6-4431-a093-84ea82ef6cfa tempest-VolumesActionsTest-1804869796 None] Lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77-detach_volume" acquired by "detach_volume" :: waited 0.026s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:10 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f89e8956-57b6-4431-a093-84ea82ef6cfa tempest-VolumesActionsTest-1804869796 None] Volume detach called, but volume not attached. Jun 19 04:24:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f89e8956-57b6-4431-a093-84ea82ef6cfa tempest-VolumesActionsTest-1804869796 None] Lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77-detach_volume" released by "detach_volume" :: held 0.068s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Acquiring lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:11 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:11 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Acquiring lock "cinder-quobyte-5d313e48-7c74-434f-8b9c-ad84b4de1b77" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:11 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Lock "cinder-quobyte-5d313e48-7c74-434f-8b9c-ad84b4de1b77" acquired by "delete_volume" :: waited 0.033s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:11 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2edda692-128d-41fb-aa31-0aa4ba78dbfa]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:11 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 Jun 19 04:24:11 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:13 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77" returned: 0 in 2.526s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:13 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77 Jun 19 04:24:13 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:15 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5d313e48-7c74-434f-8b9c-ad84b4de1b77" returned: 0 in 1.767s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:15 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Lock "cinder-quobyte-5d313e48-7c74-434f-8b9c-ad84b4de1b77" released by "delete_volume" :: held 4.440s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:15 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Created reservations ['e40fa0ed-1a72-453b-9e61-be3ddb79f6b4', '231e267e-7456-4b2d-8a86-10e845b1a3df', '30b6d658-bd92-4e98-9756-4c9905c2863a', '9624eb2a-07bd-402b-a129-7b937e6d99ed'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:16 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:24:16 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:17 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834" returned: 0 in 7.861s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[24631bb9-d1c4-4180-9026-8d85e67c2f23]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:17 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.731s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:17 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:17 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Deleted volume successfully. Jun 19 04:24:17 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a692516-67ea-452e-934d-dde12aa63f9a tempest-VolumesActionsTest-1804869796 None] Lock "cinder-5d313e48-7c74-434f-8b9c-ad84b4de1b77-delete_volume" released by "delete_volume" :: held 6.788s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:17 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 Jun 19 04:24:17 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:19 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676" returned: 0 in 1.937s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:19 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676, size 1024.00 MB, duration 7.86 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:24:19 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Converted 1024.00 MB image at 130.24 MB/s Jun 19 04:24:19 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 is being set with open permissions: ugo+rw Jun 19 04:24:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:19 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 Jun 19 04:24:19 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:20 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834" returned: 0 in 1.048s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-2f92fee3-1700-4656-a378-7db3d344a834" released by "_copy_volume_from_snapshot" :: held 13.563s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-29d0fa3e-ea2b-403a-a093-48f2b7bc8296-2f92fee3-1700-4656-a378-7db3d344a834" released by "_create_volume_from_snapshot" :: held 13.674s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.749s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 14.070s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-d7ef7d1f-78c1-4b54-bb9b-69faac532ae7-83d9e6ab-650a-49da-9461-f783e779b8db" by "_create_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-d7ef7d1f-78c1-4b54-bb9b-69faac532ae7-83d9e6ab-650a-49da-9461-f783e779b8db" acquired by "_create_volume_from_snapshot" :: waited 0.048s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Creating volume 83d9e6ab-650a-49da-9461-f783e779b8db from snapshot d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 {{(pid=93769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-83d9e6ab-650a-49da-9461-f783e779b8db" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22c8c20-9f82-4f01-a05f-d5505caecda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f92fee3-1700-4656-a378-7db3d344a834', 'volume_size': 1, 'snapshot_id': '29d0fa3e-ea2b-403a-a093-48f2b7bc8296'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23304360-be54-47fb-b319-a9de8f200459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-83d9e6ab-650a-49da-9461-f783e779b8db" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] snapshot: d7ef7d1f-78c1-4b54-bb9b-69faac532ae7, volume: 83d9e6ab-650a-49da-9461-f783e779b8db, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:24:20 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Volume volume-2f92fee3-1700-4656-a378-7db3d344a834 (2f92fee3-1700-4656-a378-7db3d344a834): created successfully Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23304360-be54-47fb-b319-a9de8f200459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Flow 'volume_create_manager' (56ceb1c4-9fc9-4213-87f6-955b6f1f8418) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a9ba16-f304-442d-bf74-6269ad1a191a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-61a21c61-b927-4f20-95cc-2e0510ad8df1 tempest-TestStampPattern-688608864 None] Created volume successfully. Jun 19 04:24:21 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 Jun 19 04:24:21 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:22 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7" returned: 0 in 1.735s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6658b386-0cec-428c-862b-634aa5e5b1c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:24:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:24:22 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a744eebb-7335-4c86-a5de-6c24a3b95f8a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:22 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 Jun 19 04:24:22 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:23 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1" returned: 0 in 1.260s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:23 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:24:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:24 devstack sudo[107778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db Jun 19 04:24:24 devstack sudo[107778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:30 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=100,cinder:SELECT=84,cinder:INSERT=22,cinder:DELETE=4 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:24:31 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=99,cinder:UPDATE=98,cinder:DELETE=11,cinder:INSERT=26 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (15a37e4c-7a08-4e28-9907-81f432c8ada7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d02464-6551-443f-95fa-eb3c577fcc5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:32 devstack sudo[107778]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35d02464-6551-443f-95fa-eb3c577fcc5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015035643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19645a1c-a333-457f-93f2-c3892c3f21d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:33Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1e7921-1bf6-42c4-af2e-edffccb3cdc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd1e7921-1bf6-42c4-af2e-edffccb3cdc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbce256-6026-4d28-8865-32b321b7e07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccbce256-6026-4d28-8865-32b321b7e07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19645a1c-a333-457f-93f2-c3892c3f21d1', 'volume_name': 'volume-19645a1c-a333-457f-93f2-c3892c3f21d1', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf79fe82-47ff-44fe-a235-6337a11a2082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf79fe82-47ff-44fe-a235-6337a11a2082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bf2620-571b-4c87-ae5b-1e2822e0f2f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:32 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Volume 19645a1c-a333-457f-93f2-c3892c3f21d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19645a1c-a333-457f-93f2-c3892c3f21d1', 'volume_size': 1} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db" returned: 0 in 8.761s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c381c1de-1985-4a62-83e1-f54ef1728199]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:32 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 Jun 19 04:24:32 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:33 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1" returned: 0 in 1.086s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:33 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1, size 1024.00 MB, duration 8.76 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:24:33 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Converted 1024.00 MB image at 116.86 MB/s Jun 19 04:24:33 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:24:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:33 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db Jun 19 04:24:33 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:34 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db" returned: 0 in 0.688s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-83d9e6ab-650a-49da-9461-f783e779b8db" released by "_copy_volume_from_snapshot" :: held 13.755s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-d7ef7d1f-78c1-4b54-bb9b-69faac532ae7-83d9e6ab-650a-49da-9461-f783e779b8db" released by "_create_volume_from_snapshot" :: held 13.821s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.872s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.823s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1015035643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19645a1c-a333-457f-93f2-c3892c3f21d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:33Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Creating volume 19645a1c-a333-457f-93f2-c3892c3f21d1 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:34 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:24:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:34 devstack sudo[107825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1 1073741824 Jun 19 04:24:34 devstack sudo[107825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:34 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9bdbb9b8-2348-4ea5-848c-a016a453570c tempest-GroupSnapshotsTest-879368004 None] Create group from source-snapshot-fc92c26c-045d-42be-8da8-490b614ca903 completed successfully. Jun 19 04:24:35 devstack sudo[107825]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1 1073741824" returned: 0 in 0.973s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:35 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1 Jun 19 04:24:35 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-83d9e6ab-650a-49da-9461-f783e779b8db" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-83d9e6ab-650a-49da-9461-f783e779b8db" acquired by "delete_volume" :: waited 0.028s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6af432-b424-4be6-b3c7-0135afac130f]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:36 devstack sudo[107833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db Jun 19 04:24:36 devstack sudo[107833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:36 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1" returned: 0 in 0.786s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.808s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0bf2620-571b-4c87-ae5b-1e2822e0f2f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19645a1c-a333-457f-93f2-c3892c3f21d1', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5b4600-ceb8-4455-903b-6ba33ef3a77b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Volume volume-19645a1c-a333-457f-93f2-c3892c3f21d1 (19645a1c-a333-457f-93f2-c3892c3f21d1): created successfully Jun 19 04:24:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c5b4600-ceb8-4455-903b-6ba33ef3a77b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (15a37e4c-7a08-4e28-9907-81f432c8ada7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f9289bc0-b8b9-410d-bf0b-587db2d3e040 tempest-VolumesActionsTest-1804869796 None] Created volume successfully. Jun 19 04:24:36 devstack sudo[107833]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db" returned: 0 in 0.926s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:36 devstack sudo[107839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db Jun 19 04:24:36 devstack sudo[107839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Acquiring lock "cinder-19645a1c-a333-457f-93f2-c3892c3f21d1-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Lock "cinder-19645a1c-a333-457f-93f2-c3892c3f21d1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Acquiring lock "cinder-quobyte-19645a1c-a333-457f-93f2-c3892c3f21d1" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Lock "cinder-quobyte-19645a1c-a333-457f-93f2-c3892c3f21d1" acquired by "delete_volume" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[145e25a5-8c0a-4931-a216-84c4eb756bfe]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:37 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1 Jun 19 04:24:37 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:37 devstack sudo[107839]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-83d9e6ab-650a-49da-9461-f783e779b8db" returned: 0 in 0.747s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-83d9e6ab-650a-49da-9461-f783e779b8db" released by "delete_volume" :: held 1.743s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Created reservations ['6301b574-f5ae-44a4-a92b-e4616280f829'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:37 devstack cinder-volume[93769]: WARNING cinder.quota [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1904000327 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1904000327, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:24:37 devstack cinder-volume[93769]: WARNING cinder.quota [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1904000327 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1904000327, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:24:37 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Created reservations ['3f486ea4-63df-43c1-af02-95dd40b58cf2', 'd0655463-6624-497b-9db4-7a97dc423f2e', '0cd960fe-d2b1-43e5-85cc-18dd01533482', '36f35420-3256-48fb-aaf7-6c08548fd032'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:38 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:24:38 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:38 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1" returned: 0 in 0.872s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:38 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1 Jun 19 04:24:38 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] group_snapshot fc92c26c-045d-42be-8da8-490b614ca903: deleting Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] group_snapshot fc92c26c-045d-42be-8da8-490b614ca903: deleting {{(pid=93769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-6658b386-0cec-428c-862b-634aa5e5b1c1" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-6658b386-0cec-428c-862b-634aa5e5b1c1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-d7ef7d1f-78c1-4b54-bb9b-69faac532ae7" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-d7ef7d1f-78c1-4b54-bb9b-69faac532ae7" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Deleting offline snapshot d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 of volume 6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] snapshot_file for this snap is: volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dc2c08-2d2a-4f5b-a6fb-46a4e1c10264]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:38 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.790s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-11be477b-1a55-4c31-b1eb-59c08293022b tempest-GroupSnapshotsTest-879368004 None] Delete group completed successfully. Jun 19 04:24:38 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-19645a1c-a333-457f-93f2-c3892c3f21d1" returned: 0 in 0.840s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:38 devstack sudo[107852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 Jun 19 04:24:38 devstack sudo[107852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Lock "cinder-quobyte-19645a1c-a333-457f-93f2-c3892c3f21d1" released by "delete_volume" :: held 1.789s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Created reservations ['454cb081-a977-4de4-9274-50077f47aa03', 'a627a657-c03c-47de-9fb6-5404cfd47c7d', 'dbac63b2-815e-47bc-b906-27d437516112', 'a1d7af9d-4185-4383-8ef5-b8385f379d87'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:39 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:24:39 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:39 devstack sudo[107852]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7" returned: 0 in 1.057s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6658b386-0cec-428c-862b-634aa5e5b1c1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8339ebf-da7c-46fe-a53d-9fed743bb9c3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:39 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 Jun 19 04:24:39 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:40 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (c65591ff-79fe-4790-9398-218521388016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dc8c83-33b7-4662-9177-fc0d1de97af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.880s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Deleted volume successfully. Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7dc8c83-33b7-4662-9177-fc0d1de97af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1090679939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68737601-e16a-4c8e-a2ce-65a65fe90936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:40Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a00cc8-2e9e-498f-bd9c-45dc0f938f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5a00cc8-2e9e-498f-bd9c-45dc0f938f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea83b42-0b30-4e81-9eff-f0b22b4dd54d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ea83b42-0b30-4e81-9eff-f0b22b4dd54d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68737601-e16a-4c8e-a2ce-65a65fe90936', 'volume_name': 'volume-68737601-e16a-4c8e-a2ce-65a65fe90936', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fad1394-e922-4eda-b10f-3028fe0214bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4fad1394-e922-4eda-b10f-3028fe0214bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28acd231-0d6b-47cb-913f-cf681499af20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:40 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Volume 68737601-e16a-4c8e-a2ce-65a65fe90936: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68737601-e16a-4c8e-a2ce-65a65fe90936', 'volume_size': 1} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1090679939',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68737601-e16a-4c8e-a2ce-65a65fe90936,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:40Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Creating volume 68737601-e16a-4c8e-a2ce-65a65fe90936 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:40 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3a89973c-6a7c-4ac3-9ce1-1db945cde7bc tempest-VolumesActionsTest-520657303 None] Lock "cinder-19645a1c-a333-457f-93f2-c3892c3f21d1-delete_volume" released by "delete_volume" :: held 3.066s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:40 devstack sudo[107863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936 1073741824 Jun 19 04:24:40 devstack sudo[107863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:40 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1" returned: 0 in 0.947s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:40 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 Jun 19 04:24:40 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:41 devstack sudo[107863]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936 1073741824" returned: 0 in 0.931s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:41 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936 Jun 19 04:24:41 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:41 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7" returned: 0 in 0.892s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:41 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7 Jun 19 04:24:41 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:41 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936" returned: 0 in 0.665s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.660s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28acd231-0d6b-47cb-913f-cf681499af20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68737601-e16a-4c8e-a2ce-65a65fe90936', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312d9ee3-82fb-45ba-ba36-b8efbcb0de04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:41 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Volume volume-68737601-e16a-4c8e-a2ce-65a65fe90936 (68737601-e16a-4c8e-a2ce-65a65fe90936): created successfully Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (312d9ee3-82fb-45ba-ba36-b8efbcb0de04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (c65591ff-79fe-4790-9398-218521388016) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9dddfeb1-f34a-4697-b84a-ca7b0b718f0f tempest-VolumesActionsTest-1804869796 None] Created volume successfully. Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:41 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:24:41 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Acquiring lock "cinder-68737601-e16a-4c8e-a2ce-65a65fe90936-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Lock "cinder-68737601-e16a-4c8e-a2ce-65a65fe90936-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Acquiring lock "cinder-quobyte-68737601-e16a-4c8e-a2ce-65a65fe90936" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Lock "cinder-quobyte-68737601-e16a-4c8e-a2ce-65a65fe90936" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ef8f8f2-f197-4238-b488-80b06c4f555d]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:42 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1.d7ef7d1f-78c1-4b54-bb9b-69faac532ae7" returned: 0 in 0.806s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-d7ef7d1f-78c1-4b54-bb9b-69faac532ae7" released by "_delete_snapshot" :: held 3.872s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-6658b386-0cec-428c-862b-634aa5e5b1c1" released by "delete_snapshot" :: held 3.908s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:42 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936 Jun 19 04:24:42 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:42 devstack cinder-volume[93769]: WARNING cinder.quota [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1904000327 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1904000327, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] Created reservations ['1e4058f2-e64a-4c1b-b739-ad487d8acdb4', 'ed0ea224-2e53-4502-836a-f9d62cf2c099', '5dce24ce-fa2e-4388-ac61-d2bc26519fa7', 'c84dd444-443b-494b-9b16-b0e31f1f4ae2'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:42 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.754s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:24:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:24:42 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c3704dba-e818-4079-abcb-529cd1b5d1e9 tempest-GroupSnapshotsTest-879368004 None] group_snapshot fc92c26c-045d-42be-8da8-490b614ca903: deleted successfully Jun 19 04:24:43 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936" returned: 0 in 0.922s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:43 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936 Jun 19 04:24:43 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-6658b386-0cec-428c-862b-634aa5e5b1c1" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-6658b386-0cec-428c-862b-634aa5e5b1c1" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:43 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[667e53a9-356b-4629-aa4f-ebbc4b1f6ef1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:43 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 Jun 19 04:24:43 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:44 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-68737601-e16a-4c8e-a2ce-65a65fe90936" returned: 0 in 0.839s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Lock "cinder-quobyte-68737601-e16a-4c8e-a2ce-65a65fe90936" released by "delete_volume" :: held 1.819s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Created reservations ['09ff972f-960d-433c-a655-5f3ca6806c1c', 'd39860bc-db3f-4fdb-a3a5-c533394d5464', '7694988f-fd41-4a63-b7a2-68b180288942', 'e2a0f446-111f-4c71-bffd-63295b88fa67'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:44 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:24:44 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:44 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1" returned: 0 in 0.952s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:44 devstack sudo[107906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1 Jun 19 04:24:44 devstack sudo[107906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:45 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (045d1fb3-3d3e-433b-a0bb-c40997349da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95568fd-21da-4657-aeab-a2b5a20c346c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.149s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Deleted volume successfully. Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d95568fd-21da-4657-aeab-a2b5a20c346c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-765378514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dd0d92-75bc-4f2a-8d65-be2482875cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:45Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa81e17d-3882-4e58-a881-a1a4edbc6e4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa81e17d-3882-4e58-a881-a1a4edbc6e4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae69cdb5-5fde-471d-b345-d3f65a423c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae69cdb5-5fde-471d-b345-d3f65a423c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99dd0d92-75bc-4f2a-8d65-be2482875cbd', 'volume_name': 'volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9518eb3-890f-4934-9f40-383529b34124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9518eb3-890f-4934-9f40-383529b34124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cc653e-416b-46e3-9230-0c3ee2689e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:45 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Volume 99dd0d92-75bc-4f2a-8d65-be2482875cbd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd', 'volume_size': 1} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-765378514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99dd0d92-75bc-4f2a-8d65-be2482875cbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:45Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Creating volume 99dd0d92-75bc-4f2a-8d65-be2482875cbd {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:45 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45a6fde1-3c56-4730-b941-129d77f17df2 tempest-VolumesActionsTest-520657303 None] Lock "cinder-68737601-e16a-4c8e-a2ce-65a65fe90936-delete_volume" released by "delete_volume" :: held 3.321s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:45 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd 1073741824 Jun 19 04:24:45 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:45 devstack sudo[107906]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6658b386-0cec-428c-862b-634aa5e5b1c1" returned: 0 in 0.987s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-6658b386-0cec-428c-862b-634aa5e5b1c1" released by "delete_volume" :: held 2.038s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Created reservations ['f8a12138-d45c-4293-b43c-fbd5c542a842'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:45 devstack cinder-volume[93769]: WARNING cinder.db.api [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1904000327'] Jun 19 04:24:45 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Created reservations ['c8d16cdd-3fd2-4b57-b10f-db837276fae0', 'ae81dc06-d400-47dc-a059-0dddce4c0b46', '5f50392f-e4a3-475d-a64b-bfa4e93fd354', '07a6beff-d87f-460b-bb53-edd8d10ab5cd'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:46 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:24:46 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:47 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd 1073741824" returned: 0 in 1.465s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7bc78843-39de-4ed7-8520-38e36a796a49 tempest-GroupSnapshotsTest-879368004 None] Group tempest-GroupSnapshotsTest-Group-1825155070: creating Jun 19 04:24:47 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd Jun 19 04:24:47 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7bc78843-39de-4ed7-8520-38e36a796a49 tempest-GroupSnapshotsTest-879368004 None] Group tempest-GroupSnapshotsTest-Group-1825155070: created successfully Jun 19 04:24:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7bc78843-39de-4ed7-8520-38e36a796a49 tempest-GroupSnapshotsTest-879368004 None] Create group completed successfully. Jun 19 04:24:47 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.171s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:47 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-61d951fc-6939-453b-ae8c-de4c7a2a21e0 tempest-GroupSnapshotsTest-879368004 None] Delete group completed successfully. Jun 19 04:24:47 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd" returned: 0 in 0.825s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] <== create_volume: return (2397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.400s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57cc653e-416b-46e3-9230-0c3ee2689e4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809c50d7-6cd7-441b-ae8b-03030cee7020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:48 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Volume volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd (99dd0d92-75bc-4f2a-8d65-be2482875cbd): created successfully Jun 19 04:24:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (809c50d7-6cd7-441b-ae8b-03030cee7020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (045d1fb3-3d3e-433b-a0bb-c40997349da7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:48 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6d5df01a-7c82-4a88-a7cd-78d7cf0aeed1 tempest-VolumesActionsTest-1804869796 None] Created volume successfully. Jun 19 04:24:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Acquiring lock "cinder-99dd0d92-75bc-4f2a-8d65-be2482875cbd-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:48 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Flow 'volume_create_manager' (2b8355a2-97a3-405e-bb30-de71f509c0b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e3d9ec-5868-4370-92e3-458b0908b53b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Lock "cinder-99dd0d92-75bc-4f2a-8d65-be2482875cbd-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33e3d9ec-5868-4370-92e3-458b0908b53b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-912827292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47b7668d-fa04-487f-b294-a67edcec7015,host='devstack@QuobyteHD#QuobyteHD',id=e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40faa17fd0a74dbb82aa69f99ef49d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:49Z,use_quota=True,user_id='e1b40877d0cf47468f05ccc34aad8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7d0969-0d4b-44b5-a92f-2e9723ac5670),volume_type_id=7b7d0969-0d4b-44b5-a92f-2e9723ac5670)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fab9e43-486e-44d3-b97e-11a4775b856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6fab9e43-486e-44d3-b97e-11a4775b856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4758d4c7-5e6b-4849-ba14-161d87235daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4758d4c7-5e6b-4849-ba14-161d87235daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b', 'volume_name': 'volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af32981-73b8-45d6-8970-372f9cbbf0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8af32981-73b8-45d6-8970-372f9cbbf0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989b8816-d142-42b2-9189-38bc7d1be5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:49 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Volume e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b', 'volume_size': 1} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47b7668d-fa04-487f-b294-a67edcec7015,created_at=2026-06-19T02:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-912827292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47b7668d-fa04-487f-b294-a67edcec7015,host='devstack@QuobyteHD#QuobyteHD',id=e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40faa17fd0a74dbb82aa69f99ef49d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:49Z,use_quota=True,user_id='e1b40877d0cf47468f05ccc34aad8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7d0969-0d4b-44b5-a92f-2e9723ac5670),volume_type_id=7b7d0969-0d4b-44b5-a92f-2e9723ac5670)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Creating volume e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:49 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:49 devstack sudo[107922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b 1073741824 Jun 19 04:24:49 devstack sudo[107922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Acquiring lock "cinder-quobyte-99dd0d92-75bc-4f2a-8d65-be2482875cbd" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Lock "cinder-quobyte-99dd0d92-75bc-4f2a-8d65-be2482875cbd" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78e987f-a13b-4ff9-94fc-0d8507628c69]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:49 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd Jun 19 04:24:49 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:50 devstack sudo[107922]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b 1073741824" returned: 0 in 1.235s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:50 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd" returned: 0 in 1.133s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:50 devstack sudo[107932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd Jun 19 04:24:50 devstack sudo[107932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:50 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b Jun 19 04:24:50 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:50 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" returned: 0 in 0.637s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:51 devstack sudo[107932]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99dd0d92-75bc-4f2a-8d65-be2482875cbd" returned: 0 in 0.681s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Lock "cinder-quobyte-99dd0d92-75bc-4f2a-8d65-be2482875cbd" released by "delete_volume" :: held 1.862s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (989b8816-d142-42b2-9189-38bc7d1be5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a940d5de-715a-4625-9f6d-9f26ecc6ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:51 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Volume volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b (e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b): created successfully Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a940d5de-715a-4625-9f6d-9f26ecc6ead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Flow 'volume_create_manager' (2b8355a2-97a3-405e-bb30-de71f509c0b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d84505d6-e822-4e16-914d-d8a18ee96eac tempest-GroupSnapshotsTest-879368004 None] Created volume successfully. Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Created reservations ['79eb8be6-1a09-4cd2-a311-bee3e5306187', 'a62b92fa-c91d-4096-be28-0091d8f78dab', '40f09ba3-9cf7-4fb4-ba24-89bdee3b0a06', '72f51342-28b6-423a-8e89-01d58ec484f4'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:51 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:24:51 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:52 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.778s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:52 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Deleted volume successfully. Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4c85a1e9-143f-44fc-a3a0-868ae548a42a tempest-VolumesActionsTest-520657303 None] Lock "cinder-99dd0d92-75bc-4f2a-8d65-be2482875cbd-delete_volume" released by "delete_volume" :: held 3.119s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Flow 'volume_create_manager' (d3f0a91d-af9c-47f7-a60e-061b5c8ccbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ef454f-bd7d-4264-8a37-0dc184467c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ef454f-bd7d-4264-8a37-0dc184467c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1147373253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47b7668d-fa04-487f-b294-a67edcec7015,host='devstack@QuobyteHD#QuobyteHD',id=0c2934f7-cb4b-47fb-a895-b134947709ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40faa17fd0a74dbb82aa69f99ef49d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:52Z,use_quota=True,user_id='e1b40877d0cf47468f05ccc34aad8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7d0969-0d4b-44b5-a92f-2e9723ac5670),volume_type_id=7b7d0969-0d4b-44b5-a92f-2e9723ac5670)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd57fbc-8cf9-429c-888e-8af2798c22ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9dd57fbc-8cf9-429c-888e-8af2798c22ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc7d560-f09e-4556-be19-273c4049379e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6bc7d560-f09e-4556-be19-273c4049379e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c2934f7-cb4b-47fb-a895-b134947709ef', 'volume_name': 'volume-0c2934f7-cb4b-47fb-a895-b134947709ef', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50685703-0fce-4c0f-9ff8-6c28a1425c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50685703-0fce-4c0f-9ff8-6c28a1425c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdde72b-d136-4ce0-a156-325dac79d45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Volume 0c2934f7-cb4b-47fb-a895-b134947709ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c2934f7-cb4b-47fb-a895-b134947709ef', 'volume_size': 1} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=47b7668d-fa04-487f-b294-a67edcec7015,created_at=2026-06-19T02:24:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1147373253',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=47b7668d-fa04-487f-b294-a67edcec7015,host='devstack@QuobyteHD#QuobyteHD',id=0c2934f7-cb4b-47fb-a895-b134947709ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40faa17fd0a74dbb82aa69f99ef49d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:52Z,use_quota=True,user_id='e1b40877d0cf47468f05ccc34aad8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b7d0969-0d4b-44b5-a92f-2e9723ac5670),volume_type_id=7b7d0969-0d4b-44b5-a92f-2e9723ac5670)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Creating volume 0c2934f7-cb4b-47fb-a895-b134947709ef {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:52 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:52 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef 1073741824 Jun 19 04:24:52 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (121026ea-e3d0-47c5-b6ea-fe1db4685b77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c20d633-7153-4a10-8f29-3feddb664a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c20d633-7153-4a10-8f29-3feddb664a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1980615532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e3bd9a-ede6-4977-a21f-5933858a60cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:53Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9805a6c2-49ca-4225-9fed-a8549f60e930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9805a6c2-49ca-4225-9fed-a8549f60e930) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d4bff8-38a0-4482-9cb6-dda45ec5bfab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5d4bff8-38a0-4482-9cb6-dda45ec5bfab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61e3bd9a-ede6-4977-a21f-5933858a60cb', 'volume_name': 'volume-61e3bd9a-ede6-4977-a21f-5933858a60cb', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7548965-5d5a-4c12-b752-21195c609286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7548965-5d5a-4c12-b752-21195c609286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a71b9e-78df-4856-997d-88b193f0ab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:52 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Volume 61e3bd9a-ede6-4977-a21f-5933858a60cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61e3bd9a-ede6-4977-a21f-5933858a60cb', 'volume_size': 1} Jun 19 04:24:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:53 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef 1073741824" returned: 0 in 0.960s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:53 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef Jun 19 04:24:53 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:54 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef" returned: 0 in 0.741s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.753s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1980615532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61e3bd9a-ede6-4977-a21f-5933858a60cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:53Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Creating volume 61e3bd9a-ede6-4977-a21f-5933858a60cb {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:54 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:54 devstack sudo[107960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb 1073741824 Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fdde72b-d136-4ce0-a156-325dac79d45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c2934f7-cb4b-47fb-a895-b134947709ef', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:54 devstack sudo[107960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6311bddd-1500-4f52-a204-6737f37efbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:54 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Volume volume-0c2934f7-cb4b-47fb-a895-b134947709ef (0c2934f7-cb4b-47fb-a895-b134947709ef): created successfully Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6311bddd-1500-4f52-a204-6737f37efbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Flow 'volume_create_manager' (d3f0a91d-af9c-47f7-a60e-061b5c8ccbd3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:54 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-74eb1d0b-6c41-44a0-a259-282e6c1a5516 tempest-GroupSnapshotsTest-879368004 None] Created volume successfully. Jun 19 04:24:54 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-965fe72c-7b4f-45c7-8844-88a1a320b1bf tempest-GroupSnapshotsTest-879368004 None] Update group completed successfully. Jun 19 04:24:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-c6af9d07-04b9-4d87-bad5-80645be1c94b req-e4a1d3eb-a6b3-4def-9052-868da1940444 tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:55 devstack sudo[107960]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb 1073741824" returned: 0 in 1.105s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:55 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb Jun 19 04:24:55 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:55 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb" returned: 0 in 0.648s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] <== create_volume: return (1797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-c6af9d07-04b9-4d87-bad5-80645be1c94b req-e4a1d3eb-a6b3-4def-9052-868da1940444 tempest-TestStampPattern-688608864 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.874s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73a71b9e-78df-4856-997d-88b193f0ab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61e3bd9a-ede6-4977-a21f-5933858a60cb', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e625662a-1f64-47bc-8e79-c29513f94bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede06234-92dc-45f5-91b3-2eb798d3bba1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-c6af9d07-04b9-4d87-bad5-80645be1c94b req-e4a1d3eb-a6b3-4def-9052-868da1940444 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:55 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Volume volume-61e3bd9a-ede6-4977-a21f-5933858a60cb (61e3bd9a-ede6-4977-a21f-5933858a60cb): created successfully Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e625662a-1f64-47bc-8e79-c29513f94bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:55 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (121026ea-e3d0-47c5-b6ea-fe1db4685b77) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:55 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-cd50821c-5a92-43c8-b329-493d3ff77fa6 tempest-VolumesActionsTest-1804869796 None] Created volume successfully. Jun 19 04:24:55 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 Jun 19 04:24:55 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ad0e0dec-8e6f-4f0c-94de-f10aa31d940d tempest-GroupSnapshotsTest-879368004 None] Update group completed successfully. Jun 19 04:24:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Acquiring lock "cinder-61e3bd9a-ede6-4977-a21f-5933858a60cb-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Lock "cinder-61e3bd9a-ede6-4977-a21f-5933858a60cb-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Acquiring lock "cinder-quobyte-61e3bd9a-ede6-4977-a21f-5933858a60cb" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:24:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Lock "cinder-quobyte-61e3bd9a-ede6-4977-a21f-5933858a60cb" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:24:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5d4ce6-ee26-4e81-a5a9-1fb0410313c8]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:24:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:56 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb Jun 19 04:24:56 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:56 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-c6af9d07-04b9-4d87-bad5-80645be1c94b req-e4a1d3eb-a6b3-4def-9052-868da1940444 tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834" returned: 0 in 0.797s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-c6af9d07-04b9-4d87-bad5-80645be1c94b req-e4a1d3eb-a6b3-4def-9052-868da1940444 tempest-TestStampPattern-688608864 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.831s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-c6af9d07-04b9-4d87-bad5-80645be1c94b req-e4a1d3eb-a6b3-4def-9052-868da1940444 tempest-TestStampPattern-688608864 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-2f92fee3-1700-4656-a378-7db3d344a834', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '06816ee5-92bf-4b92-a75a-c27e577b53c5', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:24:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-c6af9d07-04b9-4d87-bad5-80645be1c94b req-e4a1d3eb-a6b3-4def-9052-868da1940444 tempest-TestStampPattern-688608864 None] attachment_update completed successfully. Jun 19 04:24:57 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5ee4fc44-2320-4224-bdf8-fb6f91bc8890 tempest-GroupSnapshotsTest-879368004 None] Update group completed successfully. Jun 19 04:24:57 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb" returned: 0 in 0.882s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:57 devstack sudo[108063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb Jun 19 04:24:57 devstack sudo[108063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:58 devstack sudo[108063]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-61e3bd9a-ede6-4977-a21f-5933858a60cb" returned: 0 in 0.701s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Lock "cinder-quobyte-61e3bd9a-ede6-4977-a21f-5933858a60cb" released by "delete_volume" :: held 1.624s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Created reservations ['85edd3e0-9556-4e08-85ea-081bb684f4f9', '1bf576c2-1d50-4c44-9d6f-9ced2ba4fd11', '9ad337e0-23d5-4fb1-8288-77a48fc88078', 'e1248a11-e529-430c-a536-819221d9192e'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:58 devstack sudo[108384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:24:58 devstack sudo[108384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:24:58 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-954d9276-a350-4bbd-9394-4529adfc7dac tempest-GroupSnapshotsTest-879368004 None] Update group completed successfully. Jun 19 04:24:58 devstack sudo[108384]: pam_unix(sudo:session): session closed for user root Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.690s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:24:58 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Deleted volume successfully. Jun 19 04:24:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-63213544-eaea-495a-9678-05ed0d0e2378 tempest-VolumesActionsTest-520657303 None] Lock "cinder-61e3bd9a-ede6-4977-a21f-5933858a60cb-delete_volume" released by "delete_volume" :: held 2.562s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (a479f737-755f-4bfa-9237-8deb5c1035f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf88876-32db-42e0-8071-3a2db485f1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccf88876-32db-42e0-8071-3a2db485f1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-830013323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99432aa9-0706-4df7-b33f-107d421ca50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:59Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f312e18e-61d7-4a85-9e82-af264d460c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f312e18e-61d7-4a85-9e82-af264d460c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496f9d11-c530-4820-ac7e-da3b8a41a9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (496f9d11-c530-4820-ac7e-da3b8a41a9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99432aa9-0706-4df7-b33f-107d421ca50c', 'volume_name': 'volume-99432aa9-0706-4df7-b33f-107d421ca50c', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e798714-c5cc-46d4-9a11-74946eadb514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e798714-c5cc-46d4-9a11-74946eadb514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1510891a-bec5-4b3a-938e-a3a4576bc687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:24:59 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Volume 99432aa9-0706-4df7-b33f-107d421ca50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99432aa9-0706-4df7-b33f-107d421ca50c', 'volume_size': 1} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-830013323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99432aa9-0706-4df7-b33f-107d421ca50c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d7e46dbf1c54621a569dfc221f9014f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:24:59Z,use_quota=True,user_id='30ff3260f3a24e79beb3393f94c74787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Creating volume 99432aa9-0706-4df7-b33f-107d421ca50c {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:24:59 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:24:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:24:59 devstack sudo[108387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c 1073741824 Jun 19 04:24:59 devstack sudo[108387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:00 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] GroupSnapshot 4c4ac0ef-9761-4e46-a3c2-b01fcefd927b: creating. Jun 19 04:25:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Group snapshot 4c4ac0ef-9761-4e46-a3c2-b01fcefd927b: creating. {{(pid=93769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:25:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:00 devstack sudo[108387]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c 1073741824" returned: 0 in 1.036s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:00 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c Jun 19 04:25:00 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:01 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c" returned: 0 in 0.743s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.860s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Creating offline snapshot 35fa4e78-13c1-4d82-8356-4597bd0df13a of volume e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1510891a-bec5-4b3a-938e-a3a4576bc687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99432aa9-0706-4df7-b33f-107d421ca50c', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358b7c41-47e8-4119-9c10-f1078d9e6380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3524714b-c61b-4efc-8179-5cc48f0f1e1a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:01 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Volume volume-99432aa9-0706-4df7-b33f-107d421ca50c (99432aa9-0706-4df7-b33f-107d421ca50c): created successfully Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (358b7c41-47e8-4119-9c10-f1078d9e6380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Flow 'volume_create_manager' (a479f737-755f-4bfa-9237-8deb5c1035f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:01 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5191f527-b2fa-4b18-bd60-a64bf98e8185 tempest-VolumesActionsTest-1804869796 None] Created volume successfully. Jun 19 04:25:01 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b Jun 19 04:25:01 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:02 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" returned: 0 in 1.032s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:02 devstack sudo[108416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a 1G Jun 19 04:25:02 devstack sudo[108416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "cinder-99432aa9-0706-4df7-b33f-107d421ca50c-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Lock "cinder-99432aa9-0706-4df7-b33f-107d421ca50c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:03 devstack sudo[108416]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a 1G" returned: 0 in 1.166s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "cinder-quobyte-99432aa9-0706-4df7-b33f-107d421ca50c" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:03 devstack sudo[108450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a Jun 19 04:25:03 devstack sudo[108450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Lock "cinder-quobyte-99432aa9-0706-4df7-b33f-107d421ca50c" acquired by "delete_volume" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:03 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[348a410b-338f-4f15-b1ce-ef1f699eead1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:03 devstack sudo[108452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c Jun 19 04:25:03 devstack sudo[108452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:04 devstack sudo[108450]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a" returned: 0 in 0.777s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:04 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:25:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:04 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a Jun 19 04:25:04 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:04 devstack sudo[108452]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c" returned: 0 in 0.902s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:04 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c Jun 19 04:25:04 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:04 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-9b37a943-4aa3-412f-a938-aacec6ec1030 req-8c5de18c-0b46-47ec-a102-b517b45b2c27 tempest-TestStampPattern-688608864 None] Terminate volume connection completed successfully. Jun 19 04:25:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-9b37a943-4aa3-412f-a938-aacec6ec1030 req-8c5de18c-0b46-47ec-a102-b517b45b2c27 tempest-TestStampPattern-688608864 None] Deleting attachment 06816ee5-92bf-4b92-a75a-c27e577b53c5. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:25:04 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a" returned: 0 in 0.747s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:04 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.info Jun 19 04:25:04 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:05 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-99432aa9-0706-4df7-b33f-107d421ca50c" returned: 0 in 0.828s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Lock "cinder-quobyte-99432aa9-0706-4df7-b33f-107d421ca50c" released by "delete_volume" :: held 1.794s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Created reservations ['97b52c15-9bfa-4904-9d97-3ad10f0ff522', 'a2577164-240b-41d9-8806-f6f4dbf94336', '70c4c970-614c-4143-8847-5a0632b39001', 'd100db77-edb4-4e7f-ba44-0adc98056ecf'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:05 devstack sudo[108842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:25:05 devstack sudo[108842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:05 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.info" returned: 0 in 0.795s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:05 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:25:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:05 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.info Jun 19 04:25:05 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:06 devstack sudo[108842]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.795s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:06 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Deleted volume successfully. Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-45084f27-5534-467d-bc3c-d30e0f069631 tempest-VolumesActionsTest-1804869796 None] Lock "cinder-99432aa9-0706-4df7-b33f-107d421ca50c-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:06 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.info" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.454s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Creating offline snapshot 68855675-4fac-4e9a-999e-f03c93678324 of volume 0c2934f7-cb4b-47fb-a895-b134947709ef {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6303d591-3975-4249-911c-fa9e10d310a1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:06 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef Jun 19 04:25:06 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef" returned: 0 in 1.035s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:07 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:07 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 1G Jun 19 04:25:07 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:09 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 1G" returned: 0 in 1.782s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c2934f7-cb4b-47fb-a895-b134947709ef -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:09 devstack sudo[108970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c2934f7-cb4b-47fb-a895-b134947709ef -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 Jun 19 04:25:09 devstack sudo[108970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:10 devstack sudo[108970]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c2934f7-cb4b-47fb-a895-b134947709ef -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324" returned: 0 in 1.094s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:10 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:25:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:10 devstack sudo[108986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 Jun 19 04:25:10 devstack sudo[108986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:11 devstack sudo[108986]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324" returned: 0 in 1.279s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:11 devstack sudo[109113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.info Jun 19 04:25:11 devstack sudo[109113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:12 devstack sudo[109113]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.info" returned: 0 in 1.001s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:12 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:25:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:12 devstack sudo[109119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.info Jun 19 04:25:12 devstack sudo[109119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:13 devstack sudo[109119]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.info" returned: 0 in 0.876s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.198s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:14 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-cf35662d-a4f5-4c8b-8c4d-d29dce03406d tempest-GroupSnapshotsTest-879368004 None] group_snapshot 4c4ac0ef-9761-4e46-a3c2-b01fcefd927b: created successfully Jun 19 04:25:14 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] group_snapshot 4c4ac0ef-9761-4e46-a3c2-b01fcefd927b: deleting Jun 19 04:25:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] group_snapshot 4c4ac0ef-9761-4e46-a3c2-b01fcefd927b: deleting {{(pid=93769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:25:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-35fa4e78-13c1-4d82-8356-4597bd0df13a" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-35fa4e78-13c1-4d82-8356-4597bd0df13a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Deleting offline snapshot 35fa4e78-13c1-4d82-8356-4597bd0df13a of volume e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:25:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] snapshot_file for this snap is: volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:25:14 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[68366783-b051-48c7-904d-cd321ea75d30]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:14 devstack sudo[109122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a Jun 19 04:25:14 devstack sudo[109122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Flow 'volume_create_manager' (cf029996-746f-4b61-92cf-1ef18c593895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cad777-2828-455e-a31f-7f860521b190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51cad777-2828-455e-a31f-7f860521b190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2039258298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051a65fe-0589-4e97-a897-9e9941c88a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66fc7cfe9924dada49b278b11f96707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:15Z,use_quota=True,user_id='74979b0a533342b7a93fc0d3be96ab49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e015ede6-abeb-44b9-bc75-64aa3385f1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e015ede6-abeb-44b9-bc75-64aa3385f1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cda204e-85ea-4cdf-b86d-2b828f20619f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cda204e-85ea-4cdf-b86d-2b828f20619f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051a65fe-0589-4e97-a897-9e9941c88a08', 'volume_name': 'volume-051a65fe-0589-4e97-a897-9e9941c88a08', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dbebb8-8f0c-4aa7-a53c-4b9393172bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57dbebb8-8f0c-4aa7-a53c-4b9393172bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312201fc-3271-449c-9a9b-284554cbc887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:15 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Volume 051a65fe-0589-4e97-a897-9e9941c88a08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051a65fe-0589-4e97-a897-9e9941c88a08', 'volume_size': 1} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2039258298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051a65fe-0589-4e97-a897-9e9941c88a08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c66fc7cfe9924dada49b278b11f96707',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:15Z,use_quota=True,user_id='74979b0a533342b7a93fc0d3be96ab49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Creating volume 051a65fe-0589-4e97-a897-9e9941c88a08 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:15 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Acquiring lock "cinder-2f92fee3-1700-4656-a378-7db3d344a834-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:15 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 1073741824 Jun 19 04:25:15 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Lock "cinder-2f92fee3-1700-4656-a378-7db3d344a834-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Acquiring lock "cinder-quobyte-2f92fee3-1700-4656-a378-7db3d344a834" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-2f92fee3-1700-4656-a378-7db3d344a834" acquired by "delete_volume" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b89fe02e-2847-492a-9572-c6018a400a8a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:16 devstack sudo[109122]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a" returned: 0 in 1.334s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:16 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1226a4b0-438b-453e-90f7-1669fcb78666]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:16 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 Jun 19 04:25:16 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:16 devstack sudo[109132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b Jun 19 04:25:16 devstack sudo[109132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:16 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 1073741824" returned: 0 in 1.109s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:16 devstack sudo[109138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 Jun 19 04:25:16 devstack sudo[109138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:17 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834" returned: 0 in 1.529s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:17 devstack sudo[109147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834 Jun 19 04:25:17 devstack sudo[109147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:17 devstack sudo[109132]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" returned: 0 in 1.568s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:17 devstack sudo[109149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a Jun 19 04:25:17 devstack sudo[109149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:18 devstack sudo[109138]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08" returned: 0 in 1.354s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] <== create_volume: return (2588ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.596s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (312201fc-3271-449c-9a9b-284554cbc887) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051a65fe-0589-4e97-a897-9e9941c88a08', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf68037-b20c-4d60-8861-2cd8b93ae11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:18 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Volume volume-051a65fe-0589-4e97-a897-9e9941c88a08 (051a65fe-0589-4e97-a897-9e9941c88a08): created successfully Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (caf68037-b20c-4d60-8861-2cd8b93ae11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Flow 'volume_create_manager' (cf029996-746f-4b61-92cf-1ef18c593895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:18 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c96e7b93-94c5-43bc-9bcf-c7219b1c8dde tempest-TestMinimumBasicScenario-746394431 None] Created volume successfully. Jun 19 04:25:18 devstack sudo[109147]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2f92fee3-1700-4656-a378-7db3d344a834" returned: 0 in 1.239s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-2f92fee3-1700-4656-a378-7db3d344a834" released by "delete_volume" :: held 2.830s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:18 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Created reservations ['5648c8f6-26d8-4e8e-8325-13ed0c982ebb', '72bd4f8e-53fd-424d-9fca-fa8c1c906568', '38df585b-8c50-414c-8cf0-120f0efd8d98', '24f75ed2-80ea-4940-aebe-3bb29f587cfb'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:19 devstack sudo[109157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:25:19 devstack sudo[109157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:19 devstack sudo[109149]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a" returned: 0 in 1.609s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:19 devstack sudo[109163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a Jun 19 04:25:19 devstack sudo[109163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Acquiring lock "cinder-29d0fa3e-ea2b-403a-a093-48f2b7bc8296-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Lock "cinder-29d0fa3e-ea2b-403a-a093-48f2b7bc8296-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Acquiring lock "cinder-quobyte-fc6eba0f-f60b-4e58-8658-41ee0042e676" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-fc6eba0f-f60b-4e58-8658-41ee0042e676" acquired by "delete_snapshot" :: waited 0.028s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Acquiring lock "cinder-quobyte-29d0fa3e-ea2b-403a-a093-48f2b7bc8296" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-29d0fa3e-ea2b-403a-a093-48f2b7bc8296" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Deleting offline snapshot 29d0fa3e-ea2b-403a-a093-48f2b7bc8296 of volume fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:25:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] snapshot_file for this snap is: volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a133e38d-6ded-4b1e-855d-4203c8afb55b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:20 devstack sudo[109165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 Jun 19 04:25:20 devstack sudo[109165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:20 devstack sudo[109157]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.524s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:20 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Deleted volume successfully. Jun 19 04:25:20 devstack sudo[109163]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b.35fa4e78-13c1-4d82-8356-4597bd0df13a" returned: 0 in 1.340s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9b0c26ff-8177-4e1e-93a9-164c228798a4 tempest-TestStampPattern-688608864 None] Lock "cinder-2f92fee3-1700-4656-a378-7db3d344a834-delete_volume" released by "delete_volume" :: held 4.860s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-35fa4e78-13c1-4d82-8356-4597bd0df13a" released by "_delete_snapshot" :: held 5.999s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" released by "delete_snapshot" :: held 6.031s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-0c2934f7-cb4b-47fb-a895-b134947709ef" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-0c2934f7-cb4b-47fb-a895-b134947709ef" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-68855675-4fac-4e9a-999e-f03c93678324" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-68855675-4fac-4e9a-999e-f03c93678324" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Deleting offline snapshot 68855675-4fac-4e9a-999e-f03c93678324 of volume 0c2934f7-cb4b-47fb-a895-b134947709ef {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] snapshot_file for this snap is: volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e8dee0c-466c-49c3-94a7-97136fcbae3e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:20 devstack sudo[109169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 Jun 19 04:25:20 devstack sudo[109169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:21 devstack sudo[109165]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296" returned: 0 in 1.457s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc6eba0f-f60b-4e58-8658-41ee0042e676(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ba0556-c9f3-49b5-abfb-084596500774]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:21 devstack sudo[109176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 Jun 19 04:25:21 devstack sudo[109176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:21 devstack sudo[109169]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324" returned: 0 in 1.096s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c2934f7-cb4b-47fb-a895-b134947709ef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5e33928-dca3-4098-869a-bc7dc89afe29]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:22 devstack sudo[109181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef Jun 19 04:25:22 devstack sudo[109181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-1e3d2682-ccb0-4455-b34a-15956ab03111 req-cbcfb4e7-ed55-4cc4-bba0-fcb8db4ffd31 tempest-TestMinimumBasicScenario-746394431 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-1e3d2682-ccb0-4455-b34a-15956ab03111 req-cbcfb4e7-ed55-4cc4-bba0-fcb8db4ffd31 tempest-TestMinimumBasicScenario-746394431 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:22 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e3f5b3-8833-4b54-9082-ee20a9266ed9]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-1e3d2682-ccb0-4455-b34a-15956ab03111 req-cbcfb4e7-ed55-4cc4-bba0-fcb8db4ffd31 tempest-TestMinimumBasicScenario-746394431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:22 devstack sudo[109191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 Jun 19 04:25:22 devstack sudo[109191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:22 devstack sudo[109176]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676" returned: 0 in 1.319s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:22 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 Jun 19 04:25:22 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:23 devstack sudo[109181]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef" returned: 0 in 1.539s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:23 devstack sudo[109225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 Jun 19 04:25:23 devstack sudo[109225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:23 devstack sudo[109191]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-1e3d2682-ccb0-4455-b34a-15956ab03111 req-cbcfb4e7-ed55-4cc4-bba0-fcb8db4ffd31 tempest-TestMinimumBasicScenario-746394431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08" returned: 0 in 1.158s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-1e3d2682-ccb0-4455-b34a-15956ab03111 req-cbcfb4e7-ed55-4cc4-bba0-fcb8db4ffd31 tempest-TestMinimumBasicScenario-746394431 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.185s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-1e3d2682-ccb0-4455-b34a-15956ab03111 req-cbcfb4e7-ed55-4cc4-bba0-fcb8db4ffd31 tempest-TestMinimumBasicScenario-746394431 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-051a65fe-0589-4e97-a897-9e9941c88a08', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e8de080d-a2e0-4bb4-9676-f71a09c6d1a0', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:25:23 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-1e3d2682-ccb0-4455-b34a-15956ab03111 req-cbcfb4e7-ed55-4cc4-bba0-fcb8db4ffd31 tempest-TestMinimumBasicScenario-746394431 None] attachment_update completed successfully. Jun 19 04:25:23 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296" returned: 0 in 1.017s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:23 devstack sudo[109230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296 Jun 19 04:25:23 devstack sudo[109230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:24 devstack sudo[109225]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324" returned: 0 in 0.964s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:24 devstack sudo[109302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324 Jun 19 04:25:24 devstack sudo[109302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:24 devstack sudo[109230]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676.29d0fa3e-ea2b-403a-a093-48f2b7bc8296" returned: 0 in 0.745s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-29d0fa3e-ea2b-403a-a093-48f2b7bc8296" released by "_delete_snapshot" :: held 4.713s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-fc6eba0f-f60b-4e58-8658-41ee0042e676" released by "delete_snapshot" :: held 4.742s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:24 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Created reservations ['b47be268-cfa2-458e-af97-5150a20a10e0', '492910bb-31b8-4f3e-b6e7-7d0696af0a00', 'cc840765-5b09-48dc-ab6c-24c8e1155877', 'd9312f51-be6d-45f5-9362-798a82e3c3f1'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:24 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Delete snapshot completed successfully. Jun 19 04:25:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-dfbdefc1-23e1-4c93-b850-32251a01d893 tempest-TestStampPattern-688608864 None] Lock "cinder-29d0fa3e-ea2b-403a-a093-48f2b7bc8296-delete_snapshot" released by "delete_snapshot" :: held 4.938s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:25 devstack sudo[109302]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef.68855675-4fac-4e9a-999e-f03c93678324" returned: 0 in 0.760s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-68855675-4fac-4e9a-999e-f03c93678324" released by "_delete_snapshot" :: held 4.488s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-0c2934f7-cb4b-47fb-a895-b134947709ef" released by "delete_snapshot" :: held 4.523s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:25 devstack cinder-volume[93769]: WARNING cinder.quota [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2016847988 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2016847988, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:25 devstack cinder-volume[93769]: WARNING cinder.quota [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2016847988 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2016847988, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:25 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Created reservations ['7cf81957-12f1-430f-997d-b9f51240e173', 'b2e46b4e-9b4e-4d91-aaad-8009571664ee', '706bbad4-4b32-4c88-9826-98a711fb2669', 'b7101660-6a60-4a07-bb0c-20f212aaaca4'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:25 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] Created reservations ['ea379f46-188c-4445-a80c-f7aebb16b4a2', '0e4cc6b2-5122-485e-8b27-8add3dee64db', '04016d5c-2ae4-434e-b67e-1563cd26d195', '97185a7e-fe8e-4b0e-8c47-752ac4d8f853'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-2ed58176-c51a-4145-9552-4228e43f309c tempest-GroupSnapshotsTest-879368004 None] group_snapshot 4c4ac0ef-9761-4e46-a3c2-b01fcefd927b: deleted successfully Jun 19 04:25:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-0c2934f7-cb4b-47fb-a895-b134947709ef" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-0c2934f7-cb4b-47fb-a895-b134947709ef" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:26 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6113a7dc-61c1-46fd-8838-9226410fd253]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:26 devstack sudo[109627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef Jun 19 04:25:26 devstack sudo[109627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:27 devstack sudo[109627]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef" returned: 0 in 0.928s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:27 devstack sudo[109632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef Jun 19 04:25:27 devstack sudo[109632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Flow 'volume_create_manager' (a0810375-e25c-4349-b3ad-0bd565de6960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c07a338-53c6-48df-9d38-57a813fa7ea0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c07a338-53c6-48df-9d38-57a813fa7ea0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2128068323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7d0a6f-44f4-440d-a607-5027a622ba31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db003e7ce21e4de681df7f74bbcc2f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:28Z,use_quota=True,user_id='b1097c1141014548b5607750cc0cd5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0411f1d4-7317-41f3-9c15-adf2c7557cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0411f1d4-7317-41f3-9c15-adf2c7557cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041649b8-dc21-4098-9c2a-c1535db336a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (041649b8-dc21-4098-9c2a-c1535db336a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a7d0a6f-44f4-440d-a607-5027a622ba31', 'volume_name': 'volume-7a7d0a6f-44f4-440d-a607-5027a622ba31', 'volume_size': 2}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c8ab17-db9c-4553-89fb-0674457bfe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0c8ab17-db9c-4553-89fb-0674457bfe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d059e38-16b4-4a78-aed2-cfe0a9befe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:28 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Volume 7a7d0a6f-44f4-440d-a607-5027a622ba31: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a7d0a6f-44f4-440d-a607-5027a622ba31', 'volume_size': 2} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-2128068323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a7d0a6f-44f4-440d-a607-5027a622ba31,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db003e7ce21e4de681df7f74bbcc2f37',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:28Z,use_quota=True,user_id='b1097c1141014548b5607750cc0cd5c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Creating volume 7a7d0a6f-44f4-440d-a607-5027a622ba31 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:28 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 2147483648 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:28 devstack sudo[109675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 2147483648 Jun 19 04:25:28 devstack sudo[109675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:28 devstack sudo[109632]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0c2934f7-cb4b-47fb-a895-b134947709ef" returned: 0 in 1.275s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-0c2934f7-cb4b-47fb-a895-b134947709ef" released by "delete_volume" :: held 2.282s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" acquired by "delete_volume" :: waited 0.039s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd747034-9d12-4bf8-8466-272d207ed696]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:29 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b Jun 19 04:25:29 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:29 devstack sudo[109675]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 2147483648" returned: 0 in 1.556s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:29 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" returned: 0 in 1.195s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:30 devstack sudo[109696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b Jun 19 04:25:30 devstack sudo[109696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:30 devstack sudo[109697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 Jun 19 04:25:30 devstack sudo[109697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:30 devstack sudo[109696]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" returned: 0 in 0.855s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-e6b62bd0-a3d3-4567-9ba4-b8bbfedd217b" released by "delete_volume" :: held 2.158s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:30 devstack sudo[109697]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31" returned: 0 in 0.929s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] <== create_volume: return (2612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.614s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d059e38-16b4-4a78-aed2-cfe0a9befe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a7d0a6f-44f4-440d-a607-5027a622ba31', 'volume_size': 2}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fa1afd-f2bd-4437-9eb8-8d73264720d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:31 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Volume volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 (7a7d0a6f-44f4-440d-a607-5027a622ba31): created successfully Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5fa1afd-f2bd-4437-9eb8-8d73264720d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Flow 'volume_create_manager' (a0810375-e25c-4349-b3ad-0bd565de6960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=110,cinder:UPDATE=142,cinder:INSERT=28,cinder:DELETE=9 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:25:31 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e54d6f4d-2fc9-45cb-8c12-52c55435d344 tempest-VolumesCloneNegativeTest-1875866697 None] Created volume successfully. Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Created reservations ['cb555782-2ebb-4c93-afbf-99ee86b8984c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:31 devstack cinder-volume[93769]: WARNING cinder.quota [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2016847988 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2016847988, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Created reservations ['c4330725-4217-47d1-baee-fa2409843f10', 'c2fdb99f-c7a9-4275-8b17-5dd2d6fbb434', '4600e661-2774-4a13-81c1-136191862809', '6d099909-a731-44e9-a7df-6fda68c6baf6'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=129,cinder:SELECT=143,cinder:INSERT=35,cinder:DELETE=6 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Created reservations ['74e71595-2d03-4369-811a-c37e664be8cd', 'c0a00aa5-b91e-4ba3-a12d-c7b8c33fffaf', '4c78ea8f-94ad-4d1e-b7ae-354826899909', 'effcad64-9cad-4232-a79a-1cd07aa219e3'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:31 devstack sudo[109703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:25:31 devstack sudo[109703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Acquiring lock "cinder-7a7d0a6f-44f4-440d-a607-5027a622ba31-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "cinder-7a7d0a6f-44f4-440d-a607-5027a622ba31-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Acquiring lock "cinder-quobyte-7a7d0a6f-44f4-440d-a607-5027a622ba31" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "cinder-quobyte-7a7d0a6f-44f4-440d-a607-5027a622ba31" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[609a5d16-a2f9-4f0d-9d70-8e1e53e31249]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:32 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 Jun 19 04:25:32 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:32 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-4cb0fa7e-9671-428e-a35d-9da10c601eb3 tempest-GroupSnapshotsTest-879368004 None] Group tempest-GroupSnapshotsTest-Group-1219112812: creating Jun 19 04:25:32 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-4cb0fa7e-9671-428e-a35d-9da10c601eb3 tempest-GroupSnapshotsTest-879368004 None] Group tempest-GroupSnapshotsTest-Group-1219112812: created successfully Jun 19 04:25:32 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-4cb0fa7e-9671-428e-a35d-9da10c601eb3 tempest-GroupSnapshotsTest-879368004 None] Create group completed successfully. Jun 19 04:25:32 devstack sudo[109703]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.940s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:32 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:32 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-033b4313-d073-4ff9-82e0-b782625d37cb tempest-GroupSnapshotsTest-879368004 None] Delete group completed successfully. Jun 19 04:25:32 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31" returned: 0 in 0.976s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:32 devstack sudo[109714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31 Jun 19 04:25:32 devstack sudo[109714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:33 devstack sudo[109714]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7a7d0a6f-44f4-440d-a607-5027a622ba31" returned: 0 in 0.731s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "cinder-quobyte-7a7d0a6f-44f4-440d-a607-5027a622ba31" released by "delete_volume" :: held 1.770s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Acquiring lock "cinder-fc6eba0f-f60b-4e58-8658-41ee0042e676-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:33 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Created reservations ['3c34721f-55fc-42fc-ae50-3a0d168bb66f', '7596fb13-a056-42e7-bd8f-5a570e4d830c', '3f0658af-5b04-467a-a50b-4723ca5529f0', '44140484-050e-4cfc-bdd8-ecc84b5dc8eb'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Lock "cinder-fc6eba0f-f60b-4e58-8658-41ee0042e676-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Acquiring lock "cinder-quobyte-fc6eba0f-f60b-4e58-8658-41ee0042e676" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-fc6eba0f-f60b-4e58-8658-41ee0042e676" acquired by "delete_volume" :: waited 0.040s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:33 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a942d29-04c9-4a0b-b898-b6877fbe26d5]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:34 devstack sudo[109722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:25:34 devstack sudo[109722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:34 devstack sudo[109718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 Jun 19 04:25:34 devstack sudo[109718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Flow 'volume_create_manager' (781f94b6-7b67-487f-938b-6212cbca53dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dcf56e-613c-4ee8-a56e-287ebc16da1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63dcf56e-613c-4ee8-a56e-287ebc16da1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774317983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da631e77-7a79-44b0-a43c-d3279f0f7392,host='devstack@QuobyteHD#QuobyteHD',id=17af65e1-ce76-488d-ab8e-f740aa768b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40faa17fd0a74dbb82aa69f99ef49d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:34Z,use_quota=True,user_id='e1b40877d0cf47468f05ccc34aad8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01e81ef5-9d23-4add-9b7d-cc62a630afbe),volume_type_id=01e81ef5-9d23-4add-9b7d-cc62a630afbe)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f89445d-4f0d-40f2-b99d-df1947c9f824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f89445d-4f0d-40f2-b99d-df1947c9f824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8661b41c-6e2a-4282-aeac-b01fbaa423b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8661b41c-6e2a-4282-aeac-b01fbaa423b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17af65e1-ce76-488d-ab8e-f740aa768b10', 'volume_name': 'volume-17af65e1-ce76-488d-ab8e-f740aa768b10', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e50454-e902-47a1-9b3e-7100059e76cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67e50454-e902-47a1-9b3e-7100059e76cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8df1c99-0926-4feb-a42e-127f8da9a91d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:34 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Volume 17af65e1-ce76-488d-ab8e-f740aa768b10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17af65e1-ce76-488d-ab8e-f740aa768b10', 'volume_size': 1} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=da631e77-7a79-44b0-a43c-d3279f0f7392,created_at=2026-06-19T02:25:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1774317983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=da631e77-7a79-44b0-a43c-d3279f0f7392,host='devstack@QuobyteHD#QuobyteHD',id=17af65e1-ce76-488d-ab8e-f740aa768b10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40faa17fd0a74dbb82aa69f99ef49d7b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:34Z,use_quota=True,user_id='e1b40877d0cf47468f05ccc34aad8c44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(01e81ef5-9d23-4add-9b7d-cc62a630afbe),volume_type_id=01e81ef5-9d23-4add-9b7d-cc62a630afbe)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Creating volume 17af65e1-ce76-488d-ab8e-f740aa768b10 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:34 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:25:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:34 devstack sudo[109728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 1073741824 Jun 19 04:25:34 devstack sudo[109728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:35 devstack sudo[109722]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.235s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:35 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:35 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Deleted volume successfully. Jun 19 04:25:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-88f0a277-0a64-417b-bb53-e46bc85bbff7 tempest-VolumesCloneNegativeTest-1875866697 None] Lock "cinder-7a7d0a6f-44f4-440d-a607-5027a622ba31-delete_volume" released by "delete_volume" :: held 3.654s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:35 devstack sudo[109718]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676" returned: 0 in 1.510s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:35 devstack sudo[109734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676 Jun 19 04:25:35 devstack sudo[109734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:36 devstack sudo[109728]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 1073741824" returned: 0 in 1.495s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:36 devstack sudo[109740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 Jun 19 04:25:36 devstack sudo[109740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:36 devstack sudo[109734]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fc6eba0f-f60b-4e58-8658-41ee0042e676" returned: 0 in 0.932s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Lock "cinder-quobyte-fc6eba0f-f60b-4e58-8658-41ee0042e676" released by "delete_volume" :: held 2.570s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Created reservations ['87967f05-4201-4bc0-9185-2eba95a9e88f', 'c6e74566-96ce-4e2e-9095-3e147884d4e0', '83bb1401-e76f-4566-b944-7b3e6a512719', '932d1e3a-5a4f-4ec3-b681-eb4a7ce9f98f'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:36 devstack sudo[109743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:25:36 devstack sudo[109743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:37 devstack sudo[109740]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10" returned: 0 in 0.839s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] <== create_volume: return (2422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.428s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8df1c99-0926-4feb-a42e-127f8da9a91d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17af65e1-ce76-488d-ab8e-f740aa768b10', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fedc8b1-9174-420c-a5ae-59fbd830cd47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:37 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Volume volume-17af65e1-ce76-488d-ab8e-f740aa768b10 (17af65e1-ce76-488d-ab8e-f740aa768b10): created successfully Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fedc8b1-9174-420c-a5ae-59fbd830cd47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Flow 'volume_create_manager' (781f94b6-7b67-487f-938b-6212cbca53dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-2a342586-f0af-4182-a3eb-65db3bae713e tempest-GroupSnapshotsTest-879368004 None] Created volume successfully. Jun 19 04:25:37 devstack sudo[109743]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.841s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Deleted volume successfully. Jun 19 04:25:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9673d6d1-b5f4-42b2-816a-1bff5ff5493d tempest-TestStampPattern-688608864 None] Lock "cinder-fc6eba0f-f60b-4e58-8658-41ee0042e676-delete_volume" released by "delete_volume" :: held 3.776s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] GroupSnapshot a8fbe4e0-80bc-4efd-89ad-2b365b6f39ce: creating. Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Group snapshot a8fbe4e0-80bc-4efd-89ad-2b365b6f39ce: creating. {{(pid=93769) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Creating offline snapshot 617a01ab-01cf-4363-b157-b2ef59542f1f of volume 17af65e1-ce76-488d-ab8e-f740aa768b10 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b70c2b9-a1ca-4abe-b8ad-bcf4e9d820ed]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (2abced2b-5939-43d8-90b2-deb50fd05d0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe08dd4f-ac05-4cb6-948a-8da943ae3e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe08dd4f-ac05-4cb6-948a-8da943ae3e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-634030379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6ad500-df28-4c06-953a-19982bfcd142,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:39Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c24fc65-bde4-4cc4-b095-94e3229008b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c24fc65-bde4-4cc4-b095-94e3229008b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a20155d-1a68-4fbf-b5c9-7df8b261c186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:38 devstack sudo[109750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 Jun 19 04:25:38 devstack sudo[109750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a20155d-1a68-4fbf-b5c9-7df8b261c186) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d6ad500-df28-4c06-953a-19982bfcd142', 'volume_name': 'volume-2d6ad500-df28-4c06-953a-19982bfcd142', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26667cca-5623-444c-9fc7-92d1d496a98e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26667cca-5623-444c-9fc7-92d1d496a98e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64424a6c-4274-467b-a45f-22023eba155d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:38 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Volume 2d6ad500-df28-4c06-953a-19982bfcd142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d6ad500-df28-4c06-953a-19982bfcd142', 'volume_size': 1} Jun 19 04:25:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:39 devstack sudo[109750]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10" returned: 0 in 0.810s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:39 devstack sudo[109756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f 1G Jun 19 04:25:39 devstack sudo[109756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:40 devstack sudo[109756]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f 1G" returned: 0 in 0.894s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17af65e1-ce76-488d-ab8e-f740aa768b10 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:40 devstack sudo[109763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17af65e1-ce76-488d-ab8e-f740aa768b10 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f Jun 19 04:25:40 devstack sudo[109763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:41 devstack sudo[109763]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17af65e1-ce76-488d-ab8e-f740aa768b10 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f" returned: 0 in 0.872s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:41 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:25:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:41 devstack sudo[109770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f Jun 19 04:25:41 devstack sudo[109770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:25:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:42 devstack sudo[109773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:25:42 devstack sudo[109773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:42 devstack sudo[109770]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f" returned: 0 in 0.741s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:42 devstack sudo[109776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.info Jun 19 04:25:42 devstack sudo[109776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:42 devstack sudo[109773]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.698s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:25:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:25:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:25:42 devstack sudo[109776]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.info" returned: 0 in 0.737s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:42 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.info is being set with open permissions: ugo+rw: NotImplementedError Jun 19 04:25:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:42 devstack sudo[109780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.info Jun 19 04:25:42 devstack sudo[109780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:43 devstack sudo[109780]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.info" returned: 0 in 0.663s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.861s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.634s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-634030379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d6ad500-df28-4c06-953a-19982bfcd142,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:39Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Creating volume 2d6ad500-df28-4c06-953a-19982bfcd142 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:43 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:25:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:43 devstack sudo[109786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142 1073741824 Jun 19 04:25:43 devstack sudo[109786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:43 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-931e665d-1b89-45d6-9151-364a438adc64 tempest-GroupSnapshotsTest-879368004 None] group_snapshot a8fbe4e0-80bc-4efd-89ad-2b365b6f39ce: created successfully Jun 19 04:25:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] group_snapshot a8fbe4e0-80bc-4efd-89ad-2b365b6f39ce: deleting Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] group_snapshot a8fbe4e0-80bc-4efd-89ad-2b365b6f39ce: deleting {{(pid=93769) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-17af65e1-ce76-488d-ab8e-f740aa768b10" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-17af65e1-ce76-488d-ab8e-f740aa768b10" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-617a01ab-01cf-4363-b157-b2ef59542f1f" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-617a01ab-01cf-4363-b157-b2ef59542f1f" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Deleting offline snapshot 617a01ab-01cf-4363-b157-b2ef59542f1f of volume 17af65e1-ce76-488d-ab8e-f740aa768b10 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] snapshot_file for this snap is: volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6bff3e8-de1b-4676-a51f-3ec50abd593c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:44 devstack sudo[109816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f Jun 19 04:25:44 devstack sudo[109816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:44 devstack sudo[109786]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142 1073741824" returned: 0 in 1.096s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:44 devstack sudo[109818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142 Jun 19 04:25:44 devstack sudo[109818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:45 devstack sudo[109816]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f" returned: 0 in 0.973s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17af65e1-ce76-488d-ab8e-f740aa768b10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9417a8a5-9196-4744-b600-fe6ef77a815a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:45 devstack sudo[109818]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:45 devstack sudo[109824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 Jun 19 04:25:45 devstack sudo[109824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142" returned: 0 in 0.797s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] <== create_volume: return (1960ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64424a6c-4274-467b-a45f-22023eba155d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d6ad500-df28-4c06-953a-19982bfcd142', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b222fe85-c700-4cf9-a9e6-b61ca685131b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:45 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Volume volume-2d6ad500-df28-4c06-953a-19982bfcd142 (2d6ad500-df28-4c06-953a-19982bfcd142): created successfully Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b222fe85-c700-4cf9-a9e6-b61ca685131b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (2abced2b-5939-43d8-90b2-deb50fd05d0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b6b628c3-b784-44c9-8226-ff90ae977268 tempest-VolumesGetTest-1701178603 None] Created volume successfully. Jun 19 04:25:46 devstack sudo[109824]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10" returned: 0 in 1.051s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:46 devstack sudo[109830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f Jun 19 04:25:46 devstack sudo[109830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (8caab85e-7af0-4897-8f3f-de37e1abb267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f277cda8-fde9-4968-ad90-b79c15cc7e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f277cda8-fde9-4968-ad90-b79c15cc7e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2068970507',display_name='tempest-VolumesGetTest-Volume-1130378331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e174551-0122-411a-8efe-0781225d9916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:47Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600897b4-5c22-48dd-bde7-48057784992c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (600897b4-5c22-48dd-bde7-48057784992c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f805bf9c-c7c8-4150-8a4d-3e051268d428) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f805bf9c-c7c8-4150-8a4d-3e051268d428) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e174551-0122-411a-8efe-0781225d9916', 'volume_name': 'volume-5e174551-0122-411a-8efe-0781225d9916', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b151cfb-369a-4f7f-bbfa-670b36b0d957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b151cfb-369a-4f7f-bbfa-670b36b0d957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef67fb0-d3fa-4d5b-aa0c-f24e18676ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:47 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Volume 5e174551-0122-411a-8efe-0781225d9916: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e174551-0122-411a-8efe-0781225d9916', 'volume_size': 1} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:47Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2068970507',display_name='tempest-VolumesGetTest-Volume-1130378331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e174551-0122-411a-8efe-0781225d9916,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:47Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Creating volume 5e174551-0122-411a-8efe-0781225d9916 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:47 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:47 devstack sudo[109874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916 1073741824 Jun 19 04:25:47 devstack sudo[109874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:47 devstack sudo[109830]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f" returned: 0 in 1.260s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:47 devstack sudo[109882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f Jun 19 04:25:47 devstack sudo[109882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:48 devstack sudo[109882]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10.617a01ab-01cf-4363-b157-b2ef59542f1f" returned: 0 in 1.019s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:48 devstack sudo[109874]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916 1073741824" returned: 0 in 1.363s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-617a01ab-01cf-4363-b157-b2ef59542f1f" released by "_delete_snapshot" :: held 4.466s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-17af65e1-ce76-488d-ab8e-f740aa768b10" released by "delete_snapshot" :: held 4.506s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:48 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916 Jun 19 04:25:48 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:49 devstack cinder-volume[93769]: WARNING cinder.quota [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1120364200 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1120364200, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:49 devstack cinder-volume[93769]: WARNING cinder.quota [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1120364200 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1120364200, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:49 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] Created reservations ['ce922814-7cc3-4a77-a3a4-fca0f0fe7d3e', '67afcdde-1ab4-452f-8cd5-bcac8fa7f9a7', '81187036-0b12-4a0a-a710-14f9648be9cb', '02263134-9ae2-4b4d-9ddc-7302a322952c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:49 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c85d2319-2205-4ad7-9fb6-0d74602244a5 tempest-GroupSnapshotsTest-879368004 None] group_snapshot a8fbe4e0-80bc-4efd-89ad-2b365b6f39ce: deleted successfully Jun 19 04:25:50 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916" returned: 0 in 1.107s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] <== create_volume: return (2570ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.574s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ef67fb0-d3fa-4d5b-aa0c-f24e18676ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e174551-0122-411a-8efe-0781225d9916', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da6449c-71f5-4cad-ab86-378fb92be55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:50 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Volume volume-5e174551-0122-411a-8efe-0781225d9916 (5e174551-0122-411a-8efe-0781225d9916): created successfully Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7da6449c-71f5-4cad-ab86-378fb92be55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (8caab85e-7af0-4897-8f3f-de37e1abb267) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:50 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a8e5d4d2-c063-4fa4-84b4-41ab6ee91eaf tempest-VolumesGetTest-1701178603 None] Created volume successfully. Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "cinder-quobyte-17af65e1-ce76-488d-ab8e-f740aa768b10" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-17af65e1-ce76-488d-ab8e-f740aa768b10" acquired by "delete_volume" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8bd9d21-c138-4f8c-8351-c2604347f704]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-5e174551-0122-411a-8efe-0781225d9916-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Lock "cinder-5e174551-0122-411a-8efe-0781225d9916-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:50 devstack sudo[109969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 Jun 19 04:25:50 devstack sudo[109969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-quobyte-5e174551-0122-411a-8efe-0781225d9916" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-5e174551-0122-411a-8efe-0781225d9916" acquired by "delete_volume" :: waited 0.038s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52307de-ff23-41cc-9356-54049513ba3b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:51 devstack sudo[109971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916 Jun 19 04:25:51 devstack sudo[109971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:51 devstack sudo[109969]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10" returned: 0 in 0.944s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:51 devstack sudo[109978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10 Jun 19 04:25:51 devstack sudo[109978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:51 devstack sudo[109971]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916" returned: 0 in 0.928s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:51 devstack sudo[109983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916 Jun 19 04:25:51 devstack sudo[109983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:52 devstack sudo[109978]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-17af65e1-ce76-488d-ab8e-f740aa768b10" returned: 0 in 0.687s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Lock "cinder-quobyte-17af65e1-ce76-488d-ab8e-f740aa768b10" released by "delete_volume" :: held 1.786s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Created reservations ['ba64a3de-25f9-451b-9961-fd35f9ff3e13'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:52 devstack cinder-volume[93769]: WARNING cinder.quota [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1120364200 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1120364200, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Created reservations ['63e1fca1-f055-4882-80a7-bd1c07c7aee0', '9f327bab-ef33-4d53-bf53-b72290999567', '3dd18129-e80e-4969-bf92-3b0484d1991c', 'e065d5fb-2e29-4245-9642-2cd92fed7961'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:52 devstack sudo[109983]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5e174551-0122-411a-8efe-0781225d9916" returned: 0 in 0.666s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:52 devstack sudo[109987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:25:52 devstack sudo[109987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-5e174551-0122-411a-8efe-0781225d9916" released by "delete_volume" :: held 1.714s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Created reservations ['64f62c6d-0901-4338-9944-038e3d25a958', '475ad60f-50f2-4691-8012-e6ba3b729149', 'a338e53f-e431-47b9-b71f-7f073561a22e', '3f4b6a1f-aed1-43e5-b612-bfac04050803'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:52 devstack sudo[109989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:25:52 devstack sudo[109989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-2d6ad500-df28-4c06-953a-19982bfcd142-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Lock "cinder-2d6ad500-df28-4c06-953a-19982bfcd142-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-quobyte-2d6ad500-df28-4c06-953a-19982bfcd142" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-2d6ad500-df28-4c06-953a-19982bfcd142" acquired by "delete_volume" :: waited 0.044s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b21e99d-2391-46c3-9002-84ef38a10188]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:53 devstack sudo[109987]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.903s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:53 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d76aa88d-596e-4abb-86bc-81e7909ef9bb tempest-GroupSnapshotsTest-879368004 None] Delete group completed successfully. Jun 19 04:25:53 devstack sudo[109992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142 Jun 19 04:25:53 devstack sudo[109992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:53 devstack sudo[109989]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.907s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:53 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Deleted volume successfully. Jun 19 04:25:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a1b6d0fd-2593-4eef-a6a9-98304ba6a770 tempest-VolumesGetTest-1701178603 None] Lock "cinder-5e174551-0122-411a-8efe-0781225d9916-delete_volume" released by "delete_volume" :: held 2.906s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:54 devstack sudo[109992]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142" returned: 0 in 0.875s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:54 devstack sudo[109998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142 Jun 19 04:25:54 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:55 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2d6ad500-df28-4c06-953a-19982bfcd142" returned: 0 in 0.776s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-2d6ad500-df28-4c06-953a-19982bfcd142" released by "delete_volume" :: held 1.754s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:55 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Created reservations ['aebcd2c3-b490-4814-8c47-da22e3cf4461', 'f35c2680-4088-476d-b6a7-3979c9411196', '48bea515-01cb-4f99-85c5-fe9ceac625dc', '348e51b4-0374-4587-b204-a4e8f8dd95b8'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:25:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:55 devstack sudo[110007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:25:55 devstack sudo[110007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:56 devstack sudo[110007]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.903s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:25:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Deleted volume successfully. Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1faa9965-bab6-44c2-8273-9b16a4a84954 tempest-VolumesGetTest-1701178603 None] Lock "cinder-2d6ad500-df28-4c06-953a-19982bfcd142-delete_volume" released by "delete_volume" :: held 2.984s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (e52042d9-b5c1-49c0-bc6e-970c7a0ecc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183664a5-5baf-42cc-b791-235994836110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (183664a5-5baf-42cc-b791-235994836110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1151481270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6102cf35-4bfc-455d-9b7e-e6d59081c7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:56Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686a7fec-9990-40b9-8026-690a0e6f6586) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (686a7fec-9990-40b9-8026-690a0e6f6586) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a492a91-3b09-4b3b-bded-18db8c016e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a492a91-3b09-4b3b-bded-18db8c016e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6102cf35-4bfc-455d-9b7e-e6d59081c7a6', 'volume_name': 'volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a542e3-49dd-4851-abc9-0e0d138471d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a542e3-49dd-4851-abc9-0e0d138471d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaaa0e93-dc7a-4056-9e51-87c834b749ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:56 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Volume 6102cf35-4bfc-455d-9b7e-e6d59081c7a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6', 'volume_size': 1} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1151481270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6102cf35-4bfc-455d-9b7e-e6d59081c7a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:56Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Creating volume 6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:25:56 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:25:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:56 devstack sudo[110010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 1073741824 Jun 19 04:25:56 devstack sudo[110010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:57 devstack sudo[110010]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 1073741824" returned: 0 in 0.906s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:57 devstack sudo[110016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 Jun 19 04:25:57 devstack sudo[110016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:57 devstack sudo[110016]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" returned: 0 in 0.717s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:57 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] <== create_volume: return (1669ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:25:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.672s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaaa0e93-dc7a-4056-9e51-87c834b749ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca049666-edb5-4efb-b572-c10451a82fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:58 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Volume volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 (6102cf35-4bfc-455d-9b7e-e6d59081c7a6): created successfully Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca049666-edb5-4efb-b572-c10451a82fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (e52042d9-b5c1-49c0-bc6e-970c7a0ecc6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:58 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-97cda760-bbb6-4919-a56f-1a4aa97d7c56 tempest-VolumesGetTest-1701178603 None] Created volume successfully. Jun 19 04:25:58 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c87f35c4-cbc1-40c0-a532-6cfc310dc58d tempest-GroupsTest-1066763204 None] Group tempest-Group1-1717608067: creating Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (26e595c7-b848-47b9-beca-230c4f27e518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945933d6-4239-409c-8916-11d03e00f947) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:58 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c87f35c4-cbc1-40c0-a532-6cfc310dc58d tempest-GroupsTest-1066763204 None] Group tempest-Group1-1717608067: created successfully Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945933d6-4239-409c-8916-11d03e00f947) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:25:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1506248433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ca5684a-4be7-4e02-8f7a-965a630ca6b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:25:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6102cf35-4bfc-455d-9b7e-e6d59081c7a6,status='creating',terminated_at=None,updated_at=2026-06-19T02:25:59Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53840e47-ffc2-46e8-b4ee-e161c699edf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53840e47-ffc2-46e8-b4ee-e161c699edf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9503abd-8522-42fd-8241-a4e8e85625d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9503abd-8522-42fd-8241-a4e8e85625d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '1ca5684a-4be7-4e02-8f7a-965a630ca6b1', 'volume_name': 'volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1', 'volume_size': 1, 'source_volid': '6102cf35-4bfc-455d-9b7e-e6d59081c7a6', 'source_volstatus': 'available'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a960f86d-d4a6-4004-be5a-3f3d51baf976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a960f86d-d4a6-4004-be5a-3f3d51baf976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cc64ae-9452-4a2b-b460-a1d7c73a1da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:25:59 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Volume 1ca5684a-4be7-4e02-8f7a-965a630ca6b1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1', 'volume_size': 1, 'source_volid': '6102cf35-4bfc-455d-9b7e-e6d59081c7a6', 'source_volstatus': 'available'} Jun 19 04:25:59 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c87f35c4-cbc1-40c0-a532-6cfc310dc58d tempest-GroupsTest-1066763204 None] Create group completed successfully. Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:25:59 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Cloning volume 6102cf35-4bfc-455d-9b7e-e6d59081c7a6 to volume 1ca5684a-4be7-4e02-8f7a-965a630ca6b1 Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Creating offline snapshot cb15aaf8-8af3-49cd-97ca-270164a71402 of volume 6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b5207ac-7c21-405f-8128-dd71f1a07b73]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:59 devstack sudo[110019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 Jun 19 04:25:59 devstack sudo[110019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:25:59 devstack sudo[110019]: pam_unix(sudo:session): session closed for user root Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" returned: 0 in 0.878s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:25:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:25:59 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-37461599-96ef-4b46-add6-e767776bd27f tempest-GroupsTest-1066763204 None] Group tempest-Group2-1881578127: creating Jun 19 04:25:59 devstack sudo[110024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 1G Jun 19 04:25:59 devstack sudo[110024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:00 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-37461599-96ef-4b46-add6-e767776bd27f tempest-GroupsTest-1066763204 None] Group tempest-Group2-1881578127: created successfully Jun 19 04:26:00 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-37461599-96ef-4b46-add6-e767776bd27f tempest-GroupsTest-1066763204 None] Create group completed successfully. Jun 19 04:26:00 devstack sudo[110024]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 1G" returned: 0 in 0.787s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:00 devstack sudo[110029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 Jun 19 04:26:00 devstack sudo[110029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:01 devstack sudo[110029]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402" returned: 0 in 0.726s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:01 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 is being set with open permissions: ugo+rw Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:01 devstack sudo[110035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 Jun 19 04:26:01 devstack sudo[110035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Flow 'volume_create_manager' (f76d86d8-6949-4958-a603-a00ca5028d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f53822-13d6-46c7-8b47-578dbdfe13c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32f53822-13d6-46c7-8b47-578dbdfe13c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1735183611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14a67e4b-61ed-407e-820b-fc467ed0aaf0,host='devstack@QuobyteHD#QuobyteHD',id=3afd5f8b-40fb-4bc0-8cb3-c690c5cba960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4da9007ca140d8b8ce41080c9c3bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:02Z,use_quota=True,user_id='0f3415a8f9c54007a5e73d987a7499c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(795ff79a-72c5-40b3-bb5c-ac603f6b9db9),volume_type_id=795ff79a-72c5-40b3-bb5c-ac603f6b9db9)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93548daf-ddc0-4f3e-bae1-0c2698d93b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93548daf-ddc0-4f3e-bae1-0c2698d93b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94173985-1ff5-4f6e-b344-2dfa6f8ec728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94173985-1ff5-4f6e-b344-2dfa6f8ec728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3afd5f8b-40fb-4bc0-8cb3-c690c5cba960', 'volume_name': 'volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6ebec4-1d42-48b2-920a-40ed7c5b2b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f6ebec4-1d42-48b2-920a-40ed7c5b2b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fcc1b3-667d-42dd-b3e0-ccf8bfda683e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:01 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Volume 3afd5f8b-40fb-4bc0-8cb3-c690c5cba960: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960', 'volume_size': 1} Jun 19 04:26:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:02 devstack sudo[110035]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402" returned: 0 in 0.734s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:02 devstack sudo[110038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.info Jun 19 04:26:02 devstack sudo[110038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:02 devstack sudo[110038]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.info" returned: 0 in 0.624s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:02 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.info is being set with open permissions: ugo+rw Jun 19 04:26:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:02 devstack sudo[110055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.info Jun 19 04:26:02 devstack sudo[110055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:03 devstack sudo[110055]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.info" returned: 0 in 0.620s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-quobyte-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] snapshot: cb15aaf8-8af3-49cd-97ca-270164a71402, volume: 1ca5684a-4be7-4e02-8f7a-965a630ca6b1, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf9494ad-2174-4152-942e-edaf5a31898a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:03 devstack sudo[110058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 Jun 19 04:26:03 devstack sudo[110058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:04 devstack sudo[110058]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402" returned: 0 in 0.727s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:26:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:26:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:26:04 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[610fffa7-9aa0-4895-ad55-ec50c3702240]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:04 devstack sudo[110063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 Jun 19 04:26:04 devstack sudo[110063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:04 devstack sudo[110063]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" returned: 0 in 0.710s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:05 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:26:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:05 devstack sudo[110068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 Jun 19 04:26:05 devstack sudo[110068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:09 devstack sudo[110068]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" returned: 0 in 4.358s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:09 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d86cd82-badf-4c4c-9db1-45efb2312a68]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:09 devstack sudo[110081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 Jun 19 04:26:09 devstack sudo[110081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:10 devstack sudo[110081]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" returned: 0 in 0.926s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:10 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:26:10 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Converted 1024.00 MB image at 234.90 MB/s Jun 19 04:26:10 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 is being set with open permissions: ugo+rw Jun 19 04:26:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:10 devstack sudo[110086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 Jun 19 04:26:10 devstack sudo[110086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:10 devstack sudo[110086]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" returned: 0 in 0.652s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" released by "_copy_volume_from_snapshot" :: held 7.447s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-quobyte-cb15aaf8-8af3-49cd-97ca-270164a71402" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-cb15aaf8-8af3-49cd-97ca-270164a71402" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Deleting offline snapshot cb15aaf8-8af3-49cd-97ca-270164a71402 of volume 6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:26:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] snapshot_file for this snap is: volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:26:11 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[43dd82b3-87e4-432f-827e-ae7a616a26fd]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:11 devstack sudo[110093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 Jun 19 04:26:11 devstack sudo[110093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:11 devstack sudo[110093]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402" returned: 0 in 0.820s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:26:11 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1aafe26-8475-48d4-8dad-b8d5cddef016]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:12 devstack sudo[110100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 Jun 19 04:26:12 devstack sudo[110100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:12 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=70,cinder:INSERT=21,cinder:UPDATE=83,cinder:DELETE=5 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:26:12 devstack sudo[110100]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" returned: 0 in 1.023s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:12 devstack sudo[110144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 Jun 19 04:26:12 devstack sudo[110144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:13 devstack sudo[110144]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402" returned: 0 in 0.729s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:13 devstack sudo[110149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402 Jun 19 04:26:13 devstack sudo[110149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:14 devstack sudo[110149]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6.cb15aaf8-8af3-49cd-97ca-270164a71402" returned: 0 in 0.682s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-cb15aaf8-8af3-49cd-97ca-270164a71402" released by "_delete_snapshot" :: held 3.362s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 15.370s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.634s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=14a67e4b-61ed-407e-820b-fc467ed0aaf0,created_at=2026-06-19T02:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1735183611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=14a67e4b-61ed-407e-820b-fc467ed0aaf0,host='devstack@QuobyteHD#QuobyteHD',id=3afd5f8b-40fb-4bc0-8cb3-c690c5cba960,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4da9007ca140d8b8ce41080c9c3bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:02Z,use_quota=True,user_id='0f3415a8f9c54007a5e73d987a7499c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(795ff79a-72c5-40b3-bb5c-ac603f6b9db9),volume_type_id=795ff79a-72c5-40b3-bb5c-ac603f6b9db9)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Creating volume 3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:14 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:14 devstack sudo[110155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 1073741824 Jun 19 04:26:14 devstack sudo[110155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76cc64ae-9452-4a2b-b460-a1d7c73a1da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1', 'volume_size': 1, 'source_volid': '6102cf35-4bfc-455d-9b7e-e6d59081c7a6', 'source_volstatus': 'available'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f19ca4d-6596-4bfa-9c49-7bc567f6d204) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:14 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Volume volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 (1ca5684a-4be7-4e02-8f7a-965a630ca6b1): created successfully Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f19ca4d-6596-4bfa-9c49-7bc567f6d204) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (26e595c7-b848-47b9-beca-230c4f27e518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:14 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a0256090-e239-44d3-966e-2ee8650ec20e tempest-VolumesGetTest-1701178603 None] Created volume successfully. Jun 19 04:26:14 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-cdf19c7d-c379-4be8-a5ff-13602549ee53 req-ce5e757e-c0e1-451c-992f-9e2b8cbbd89f tempest-TestMinimumBasicScenario-746394431 None] Terminate volume connection completed successfully. Jun 19 04:26:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-cdf19c7d-c379-4be8-a5ff-13602549ee53 req-ce5e757e-c0e1-451c-992f-9e2b8cbbd89f tempest-TestMinimumBasicScenario-746394431 None] Deleting attachment e8de080d-a2e0-4bb4-9676-f71a09c6d1a0. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:26:15 devstack sudo[110155]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 1073741824" returned: 0 in 0.854s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:15 devstack sudo[110164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 Jun 19 04:26:15 devstack sudo[110164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (26b13b54-710c-4279-974c-342b8a3ec3fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8e199a-1e00-4f57-8881-ddb9ee46ef84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc8e199a-1e00-4f57-8881-ddb9ee46ef84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-56398179',display_name='tempest-VolumesGetTest-Volume-1588096498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81a64b6-7e39-47dd-9d20-cf68599d7350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:16Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a93de9d-74aa-4798-91a3-ab85f2c8c580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a93de9d-74aa-4798-91a3-ab85f2c8c580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234c5bfa-7694-47bf-bff5-dd892f1825a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (234c5bfa-7694-47bf-bff5-dd892f1825a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e81a64b6-7e39-47dd-9d20-cf68599d7350', 'volume_name': 'volume-e81a64b6-7e39-47dd-9d20-cf68599d7350', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e36223-b66d-448b-8575-78697ea3b303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4e36223-b66d-448b-8575-78697ea3b303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8279dce4-3e7d-463d-b394-cabe6d440bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:15 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Volume e81a64b6-7e39-47dd-9d20-cf68599d7350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e81a64b6-7e39-47dd-9d20-cf68599d7350', 'volume_size': 1} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:15 devstack sudo[110164]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960" returned: 0 in 0.652s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] <== create_volume: return (1559ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.562s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.277s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:15Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-56398179',display_name='tempest-VolumesGetTest-Volume-1588096498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e81a64b6-7e39-47dd-9d20-cf68599d7350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:16Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Creating volume e81a64b6-7e39-47dd-9d20-cf68599d7350 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:15 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13fcc1b3-667d-42dd-b3e0-ccf8bfda683e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:16 devstack sudo[110167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 1073741824 Jun 19 04:26:16 devstack sudo[110167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0b62b1-2e8f-45d4-9cf7-874394477c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:16 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Volume volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 (3afd5f8b-40fb-4bc0-8cb3-c690c5cba960): created successfully Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a0b62b1-2e8f-45d4-9cf7-874394477c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Flow 'volume_create_manager' (f76d86d8-6949-4958-a603-a00ca5028d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:16 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-15c89a3f-61c5-4179-90c5-242dcbe869c6 tempest-GroupsTest-1066763204 None] Created volume successfully. Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Acquiring lock "cinder-051a65fe-0589-4e97-a897-9e9941c88a08-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Lock "cinder-051a65fe-0589-4e97-a897-9e9941c88a08-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Acquiring lock "cinder-quobyte-051a65fe-0589-4e97-a897-9e9941c88a08" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Lock "cinder-quobyte-051a65fe-0589-4e97-a897-9e9941c88a08" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b1de27b-e2d5-4bfd-96ae-ea863e7c65b7]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:16 devstack sudo[110167]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:16 devstack sudo[110173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 1073741824" returned: 0 in 0.889s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:16 devstack sudo[110173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:16 devstack sudo[110175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 Jun 19 04:26:16 devstack sudo[110175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Acquiring lock "cinder-quobyte-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Lock "cinder-quobyte-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2f6d873-b153-4c3b-9117-9bd6c4557850]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:17 devstack sudo[110177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 Jun 19 04:26:17 devstack sudo[110177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:17 devstack sudo[110173]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08" returned: 0 in 0.814s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:17 devstack sudo[110175]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350" returned: 0 in 0.680s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:17 devstack sudo[110183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08 Jun 19 04:26:17 devstack sudo[110183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8279dce4-3e7d-463d-b394-cabe6d440bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e81a64b6-7e39-47dd-9d20-cf68599d7350', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9641ee-7625-4f88-8b8c-7da8222eb798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:17 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Volume volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 (e81a64b6-7e39-47dd-9d20-cf68599d7350): created successfully Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9641ee-7625-4f88-8b8c-7da8222eb798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:17 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (26b13b54-710c-4279-974c-342b8a3ec3fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:17 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-8376a64b-2798-4907-952e-409a2126f799 tempest-VolumesGetTest-1701178603 None] Created volume successfully. Jun 19 04:26:18 devstack sudo[110177]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960" returned: 0 in 0.834s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:18 devstack sudo[110188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960 Jun 19 04:26:18 devstack sudo[110188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:18 devstack sudo[110183]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-051a65fe-0589-4e97-a897-9e9941c88a08" returned: 0 in 0.650s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Lock "cinder-quobyte-051a65fe-0589-4e97-a897-9e9941c88a08" released by "delete_volume" :: held 1.502s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Created reservations ['856fc653-23c2-411c-870c-2a6eba3b01d7', 'aec1bdf9-7e40-46d6-bc4d-07b898fb1ed6', 'fb8dd0e6-805b-40df-b9e9-a2cca1725d25', 'a2dbc2b5-4b1a-4396-8e17-e34c43abc97f'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:18 devstack sudo[110191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:18 devstack sudo[110191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:18 devstack sudo[110188]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960" returned: 0 in 0.657s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Lock "cinder-quobyte-3afd5f8b-40fb-4bc0-8cb3-c690c5cba960" released by "delete_volume" :: held 1.553s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Created reservations ['11d1c85f-61d1-4ce8-a84c-4e767ec52991'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:18 devstack cinder-volume[93769]: WARNING cinder.quota [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1070732648 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1070732648, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:26:18 devstack cinder-volume[93769]: WARNING cinder.quota [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1070732648 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1070732648, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Created reservations ['d0cdfaf1-9c6a-4e11-afc0-0bd13a5a790a', '990b3239-f929-4b5d-a01d-ed5557daf6e1', 'd35b033a-e005-43c7-9b79-0de05cf9d3b4', '7c7b636a-70d0-490c-8028-1d074dab6b14'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-e81a64b6-7e39-47dd-9d20-cf68599d7350-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Lock "cinder-e81a64b6-7e39-47dd-9d20-cf68599d7350-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:19 devstack sudo[110191]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.670s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:19 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Deleted volume successfully. Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-quobyte-e81a64b6-7e39-47dd-9d20-cf68599d7350" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-e81a64b6-7e39-47dd-9d20-cf68599d7350" acquired by "delete_volume" :: waited 0.041s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:19 devstack sudo[110195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:19 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3bd40bba-5a48-456e-841c-34648ef33d11 tempest-TestMinimumBasicScenario-746394431 None] Lock "cinder-051a65fe-0589-4e97-a897-9e9941c88a08-delete_volume" released by "delete_volume" :: held 2.523s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c1d6b74-d345-4d7b-b0b0-d93c2fc54fec]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:19 devstack sudo[110197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 Jun 19 04:26:19 devstack sudo[110197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] Created reservations ['a90114f9-d26c-4080-9228-21a2f3e93628'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:19 devstack sudo[110200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:19 devstack sudo[110200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:19 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.689s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:19 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-59e3f10c-91a9-4807-a865-a076bff9de3b tempest-GroupsTest-1066763204 None] Delete group completed successfully. Jun 19 04:26:19 devstack sudo[110197]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350" returned: 0 in 0.789s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:20 devstack sudo[110205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350 Jun 19 04:26:20 devstack sudo[110205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:20 devstack sudo[110200]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.876s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:20 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:20 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-698d334f-6d27-4c3a-b264-412ed839a2c8 tempest-GroupsTest-1066763204 None] Delete group completed successfully. Jun 19 04:26:20 devstack sudo[110205]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e81a64b6-7e39-47dd-9d20-cf68599d7350" returned: 0 in 0.893s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-e81a64b6-7e39-47dd-9d20-cf68599d7350" released by "delete_volume" :: held 1.743s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:20 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Created reservations ['59eba4a0-18af-44af-8d91-cda64be66d55', '0def1949-dfd4-419c-966c-dcaec4578391', '64cf3e29-ff26-4538-9477-9df070f2dbba', 'b7368fe7-5947-4235-923b-7a0bb1e85b16'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:21 devstack sudo[110252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:21 devstack sudo[110252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-1ca5684a-4be7-4e02-8f7a-965a630ca6b1-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Lock "cinder-1ca5684a-4be7-4e02-8f7a-965a630ca6b1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-quobyte-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6ce86ffd-6be7-47d3-a2f7-44bca5de6042 tempest-GroupsTest-1066763204 None] Group tempest-GroupsTest-Group-1314330431: creating Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a90d7d-b38c-4934-ac89-4ff1f9b6562b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6ce86ffd-6be7-47d3-a2f7-44bca5de6042 tempest-GroupsTest-1066763204 None] Group tempest-GroupsTest-Group-1314330431: created successfully Jun 19 04:26:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6ce86ffd-6be7-47d3-a2f7-44bca5de6042 tempest-GroupsTest-1066763204 None] Create group completed successfully. Jun 19 04:26:21 devstack sudo[110255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 Jun 19 04:26:21 devstack sudo[110255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:21 devstack sudo[110252]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.752s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Deleted volume successfully. Jun 19 04:26:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-90f9173b-25cb-4b3d-b068-8f91cda89711 tempest-VolumesGetTest-1701178603 None] Lock "cinder-e81a64b6-7e39-47dd-9d20-cf68599d7350-delete_volume" released by "delete_volume" :: held 2.847s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:22 devstack sudo[110255]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" returned: 0 in 0.849s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:22 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1 Jun 19 04:26:22 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:23 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" returned: 0 in 0.641s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-1ca5684a-4be7-4e02-8f7a-965a630ca6b1" released by "delete_volume" :: held 1.537s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Created reservations ['2418314a-6ade-4d7c-a39d-f6ce16839829', 'b9084483-afcf-44f8-aa41-a52048410106', '73104fac-caf9-42cb-b801-575456ca7868', '64933bce-647e-4278-8826-7fb2a27f9441'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:23 devstack sudo[110267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:23 devstack sudo[110267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Flow 'volume_create_manager' (38783402-f433-4267-9d98-e2eb63a01307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932b4dd7-fbed-4bb1-bcc0-8d98cec59bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (932b4dd7-fbed-4bb1-bcc0-8d98cec59bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-765104311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b77fafbf-11a4-4565-b642-354e918c77f6,host='devstack@QuobyteHD#QuobyteHD',id=15eda103-58aa-446e-bb94-54b188a2c5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4da9007ca140d8b8ce41080c9c3bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:23Z,use_quota=True,user_id='0f3415a8f9c54007a5e73d987a7499c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d8a279-8776-45e3-b8cb-52025d36eb33),volume_type_id=90d8a279-8776-45e3-b8cb-52025d36eb33)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5154b268-b12b-4624-8da4-155c3472c3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5154b268-b12b-4624-8da4-155c3472c3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf18e06-927b-4caf-85e6-241403f320e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf18e06-927b-4caf-85e6-241403f320e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15eda103-58aa-446e-bb94-54b188a2c5d7', 'volume_name': 'volume-15eda103-58aa-446e-bb94-54b188a2c5d7', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e49080-8091-4de7-b98c-b968a1545793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8e49080-8091-4de7-b98c-b968a1545793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7232d42-c5cb-47a3-a322-17d587e6d215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:23 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Volume 15eda103-58aa-446e-bb94-54b188a2c5d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15eda103-58aa-446e-bb94-54b188a2c5d7', 'volume_size': 1} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b77fafbf-11a4-4565-b642-354e918c77f6,created_at=2026-06-19T02:26:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-765104311',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b77fafbf-11a4-4565-b642-354e918c77f6,host='devstack@QuobyteHD#QuobyteHD',id=15eda103-58aa-446e-bb94-54b188a2c5d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4da9007ca140d8b8ce41080c9c3bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:23Z,use_quota=True,user_id='0f3415a8f9c54007a5e73d987a7499c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d8a279-8776-45e3-b8cb-52025d36eb33),volume_type_id=90d8a279-8776-45e3-b8cb-52025d36eb33)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Creating volume 15eda103-58aa-446e-bb94-54b188a2c5d7 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:23 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:23 devstack sudo[110269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7 1073741824 Jun 19 04:26:23 devstack sudo[110269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-6102cf35-4bfc-455d-9b7e-e6d59081c7a6-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Lock "cinder-6102cf35-4bfc-455d-9b7e-e6d59081c7a6-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-quobyte-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d35dd0f-6c78-4f8f-883d-d188683fa6c5]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:23 devstack sudo[110271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 Jun 19 04:26:23 devstack sudo[110271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:23 devstack sudo[110267]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.755s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:23 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:23 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Deleted volume successfully. Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-718769ff-658d-40bf-a778-afc85731ff85 tempest-VolumesGetTest-1701178603 None] Lock "cinder-1ca5684a-4be7-4e02-8f7a-965a630ca6b1-delete_volume" released by "delete_volume" :: held 2.586s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:24 devstack sudo[110269]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7 1073741824" returned: 0 in 0.823s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:24 devstack sudo[110277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7 Jun 19 04:26:24 devstack sudo[110277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:24 devstack sudo[110271]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" returned: 0 in 0.809s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:24 devstack sudo[110282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6 Jun 19 04:26:24 devstack sudo[110282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:24 devstack sudo[110277]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7" returned: 0 in 0.720s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7232d42-c5cb-47a3-a322-17d587e6d215) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15eda103-58aa-446e-bb94-54b188a2c5d7', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6435376-a98c-44c2-b39a-2220a2157e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:24 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Volume volume-15eda103-58aa-446e-bb94-54b188a2c5d7 (15eda103-58aa-446e-bb94-54b188a2c5d7): created successfully Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6435376-a98c-44c2-b39a-2220a2157e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Flow 'volume_create_manager' (38783402-f433-4267-9d98-e2eb63a01307) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1f994d1e-7bf3-455e-99d6-444bfd7c73a6 tempest-GroupsTest-1066763204 None] Created volume successfully. Jun 19 04:26:25 devstack sudo[110282]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" returned: 0 in 0.643s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-6102cf35-4bfc-455d-9b7e-e6d59081c7a6" released by "delete_volume" :: held 1.528s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:25 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Created reservations ['6e72f452-e71c-4e8f-bbbb-9e384e20cb51', 'd8a291d2-0f1b-4e69-9af9-4d0f93429943', '429731d7-f42b-4d0b-bb4d-d9d027f9d1d4', 'cf9c2823-c847-4c6d-979c-11f0c7c608fd'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:25 devstack sudo[110286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:25 devstack sudo[110286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:26 devstack sudo[110286]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Flow 'volume_create_manager' (3343426a-2d2d-4855-99ee-85996b2be75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948bfa42-dbbd-4f1a-ad71-70858bff1987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.779s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:26 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Deleted volume successfully. Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948bfa42-dbbd-4f1a-ad71-70858bff1987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-476403069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b77fafbf-11a4-4565-b642-354e918c77f6,host='devstack@QuobyteHD#QuobyteHD',id=e83db2ad-e7e2-4432-905a-c439719772dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4da9007ca140d8b8ce41080c9c3bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:26Z,use_quota=True,user_id='0f3415a8f9c54007a5e73d987a7499c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d8a279-8776-45e3-b8cb-52025d36eb33),volume_type_id=90d8a279-8776-45e3-b8cb-52025d36eb33)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a403829-776e-4000-bc0c-c7e8dc1dc744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a403829-776e-4000-bc0c-c7e8dc1dc744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bccf46-4fde-4a84-b0de-29b59c1859a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81bccf46-4fde-4a84-b0de-29b59c1859a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e83db2ad-e7e2-4432-905a-c439719772dd', 'volume_name': 'volume-e83db2ad-e7e2-4432-905a-c439719772dd', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c81ad9-d0aa-44b4-accd-8e2c344c2bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57c81ad9-d0aa-44b4-accd-8e2c344c2bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1335f6-6e41-40b2-a238-8a42f6556ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:26 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Volume e83db2ad-e7e2-4432-905a-c439719772dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e83db2ad-e7e2-4432-905a-c439719772dd', 'volume_size': 1} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b77fafbf-11a4-4565-b642-354e918c77f6,created_at=2026-06-19T02:26:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-476403069',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b77fafbf-11a4-4565-b642-354e918c77f6,host='devstack@QuobyteHD#QuobyteHD',id=e83db2ad-e7e2-4432-905a-c439719772dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af4da9007ca140d8b8ce41080c9c3bf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:26Z,use_quota=True,user_id='0f3415a8f9c54007a5e73d987a7499c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90d8a279-8776-45e3-b8cb-52025d36eb33),volume_type_id=90d8a279-8776-45e3-b8cb-52025d36eb33)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Creating volume e83db2ad-e7e2-4432-905a-c439719772dd {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:26 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:26 devstack sudo[110289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd 1073741824 Jun 19 04:26:26 devstack sudo[110289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4a6b1aa7-7e88-4031-be03-04027e20b64c tempest-VolumesGetTest-1701178603 None] Lock "cinder-6102cf35-4bfc-455d-9b7e-e6d59081c7a6-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (175e2f90-5fd8-4b8c-a646-3f81faf34fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf5c10c-33e2-46b1-9e2e-1b801cd65e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9bf5c10c-33e2-46b1-9e2e-1b801cd65e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-711379449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a724267-404e-417a-8d23-0c8efba7115e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:27Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754c1e88-97be-437d-9804-6c7fb06154a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (754c1e88-97be-437d-9804-6c7fb06154a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5749f988-c27d-4fe3-9bc4-8d5d362dcdec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.image.glance [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Creating Keystone auth plugin from conf {{(pid=93769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:26:27 devstack sudo[110289]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd 1073741824" returned: 0 in 0.975s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:27 devstack sudo[110295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd Jun 19 04:26:27 devstack sudo[110295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5749f988-c27d-4fe3-9bc4-8d5d362dcdec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6a724267-404e-417a-8d23-0c8efba7115e', 'volume_name': 'volume-6a724267-404e-417a-8d23-0c8efba7115e', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a35d73-a843-4f49-aa9f-395c4c8e8d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07a35d73-a843-4f49-aa9f-395c4c8e8d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47062879-42b9-4317-a69b-7c5c2d25d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:27 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Volume 6a724267-404e-417a-8d23-0c8efba7115e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6a724267-404e-417a-8d23-0c8efba7115e', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Trying to clone 6a724267-404e-417a-8d23-0c8efba7115e from image f472f64e-f7ec-4170-b06c-8de073bddf2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]). {{(pid=93769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:26:27 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84040a6-e6bf-468f-9c69-b7d35c3c744b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:27 devstack sudo[110298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD Jun 19 04:26:27 devstack sudo[110298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:28 devstack sudo[110295]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd" returned: 0 in 0.799s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] <== create_volume: return (1839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.843s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc1335f6-6e41-40b2-a238-8a42f6556ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e83db2ad-e7e2-4432-905a-c439719772dd', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fe0609-ce6b-4f05-81c9-48ae66d5e5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:28 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Volume volume-e83db2ad-e7e2-4432-905a-c439719772dd (e83db2ad-e7e2-4432-905a-c439719772dd): created successfully Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8fe0609-ce6b-4f05-81c9-48ae66d5e5c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Flow 'volume_create_manager' (3343426a-2d2d-4855-99ee-85996b2be75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b12e61d5-bbc8-44e7-a752-38ad9118fa92 tempest-GroupsTest-1066763204 None] Created volume successfully. Jun 19 04:26:28 devstack sudo[110298]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD" returned: 0 in 0.785s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Temporary image f472f64e-f7ec-4170-b06c-8de073bddf2f is fetched for user 5db965fcdee54a0f928c1dee1ac5d474. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b0bb395-babc-4a67-aa24-9f99ce736f0a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7066ef2b-e6d9-4536-a2ce-23c3d8365de8 tempest-GroupsTest-1066763204 None] Update group completed successfully. Jun 19 04:26:28 devstack sudo[110305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD Jun 19 04:26:28 devstack sudo[110305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:29 devstack sudo[110305]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD" returned: 0 in 0.693s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-711379449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a724267-404e-417a-8d23-0c8efba7115e,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:27Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Creating volume 6a724267-404e-417a-8d23-0c8efba7115e {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:29 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:29 devstack sudo[110310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e 1073741824 Jun 19 04:26:29 devstack sudo[110310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:30 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d2a6f417-abb4-481d-864a-d46e5ebdb9ae tempest-GroupsTest-1066763204 None] Update group completed successfully. Jun 19 04:26:30 devstack sudo[110310]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e 1073741824" returned: 0 in 0.955s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:30 devstack sudo[110316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e Jun 19 04:26:30 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:31 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e" returned: 0 in 0.658s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] <== create_volume: return (1657ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Attempting download of f472f64e-f7ec-4170-b06c-8de073bddf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}])) to volume 6a724267-404e-417a-8d23-0c8efba7115e. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1e105d-cc18-4ad0-807c-cb6aef454890]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_2qv66_1c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:31 devstack sudo[110320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_2qv66_1c Jun 19 04:26:31 devstack sudo[110320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:31 devstack sudo[110320]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_2qv66_1c" returned: 0 in 0.757s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_2qv66_1c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Acquiring lock "cinder-quobyte-15eda103-58aa-446e-bb94-54b188a2c5d7" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Lock "cinder-quobyte-15eda103-58aa-446e-bb94-54b188a2c5d7" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca074656-0597-4cf5-8a45-5b195a67100c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:32 devstack sudo[110325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_2qv66_1c Jun 19 04:26:32 devstack sudo[110325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:32 devstack sudo[110326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7 Jun 19 04:26:32 devstack sudo[110326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:32 devstack sudo[110325]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_2qv66_1c" returned: 1 in 0.812s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_2qv66_1c' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:26:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc2b7ef6-708f-4dc3-b79c-90508e2a1bcb]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:32 devstack sudo[110332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD Jun 19 04:26:32 devstack sudo[110332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:32 devstack sudo[110326]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7" returned: 0 in 0.874s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:32 devstack sudo[110337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7 Jun 19 04:26:32 devstack sudo[110337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:33 devstack sudo[110332]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD" returned: 0 in 0.804s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:33 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] f472f64e-f7ec-4170-b06c-8de073bddf2f was qcow2, converting to raw {{(pid=93769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:26:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:33 devstack sudo[110343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e Jun 19 04:26:33 devstack sudo[110343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:33 devstack sudo[110337]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-15eda103-58aa-446e-bb94-54b188a2c5d7" returned: 0 in 0.701s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Lock "cinder-quobyte-15eda103-58aa-446e-bb94-54b188a2c5d7" released by "delete_volume" :: held 1.637s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Acquiring lock "cinder-quobyte-e83db2ad-e7e2-4432-905a-c439719772dd" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Lock "cinder-quobyte-e83db2ad-e7e2-4432-905a-c439719772dd" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:33 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[178fae2c-f85a-4107-8243-11fce5933982]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:33 devstack sudo[110345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd Jun 19 04:26:33 devstack sudo[110345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:34 devstack sudo[110345]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd" returned: 0 in 0.982s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:34 devstack sudo[110360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd Jun 19 04:26:34 devstack sudo[110360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:35 devstack sudo[110360]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e83db2ad-e7e2-4432-905a-c439719772dd" returned: 0 in 0.755s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Lock "cinder-quobyte-e83db2ad-e7e2-4432-905a-c439719772dd" released by "delete_volume" :: held 1.797s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=147,cinder:SELECT=121,cinder:INSERT=32,cinder:DELETE=8 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Created reservations ['a489baca-1b62-4b15-b3c6-5d5f228b66fb'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:35 devstack cinder-volume[93769]: WARNING cinder.quota [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1250140626 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1250140626, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:26:35 devstack cinder-volume[93769]: WARNING cinder.quota [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1250140626 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1250140626, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Created reservations ['ecb53613-045c-4797-9320-80874e7a7d9e', 'dde6514e-57d5-4e7b-8ca2-e99fff4c3363', 'e0d87720-9992-4463-a7a2-9f512e8a26ce', '4867d429-1be9-4104-86f5-9c18d3739533'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Created reservations ['16bd5efa-6334-4429-8d34-4830e802c864', '2421a89a-7bef-4c3a-bd91-f17a1fd322d0', 'fdcdfae6-cf4c-44c6-b15e-b9c8faf7674c', '87d32df4-4c39-443f-a631-396e1afd51e4'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:35 devstack sudo[110343]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e" returned: 0 in 2.479s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:36 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_wp79uplxdevstack@QuobyteHD, size 112.00 MB, duration 2.48 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:26:36 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Converted 112.00 MB image at 45.15 MB/s Jun 19 04:26:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:36 devstack sudo[110363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:36 devstack sudo[110363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:36 devstack sudo[110364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e 1G Jun 19 04:26:36 devstack sudo[110364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:36 devstack sudo[110363]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.719s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:36 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-46919ae9-cd6a-40b6-905a-4ebbf7e195e6 tempest-GroupsTest-1066763204 None] Delete group completed successfully. Jun 19 04:26:36 devstack sudo[110364]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e 1G" returned: 0 in 0.767s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:36 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[561c63fa-ac24-461f-be94-8cc8bac1a369]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:36 devstack sudo[110371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e Jun 19 04:26:36 devstack sudo[110371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:37 devstack sudo[110371]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e" returned: 0 in 0.900s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:37 devstack sudo[110375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e Jun 19 04:26:37 devstack sudo[110375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:38 devstack sudo[110375]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e" returned: 1 in 0.823s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Downloaded image f472f64e-f7ec-4170-b06c-8de073bddf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}])) to volume 6a724267-404e-417a-8d23-0c8efba7115e successfully. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Temporary image f472f64e-f7ec-4170-b06c-8de073bddf2f for user 5db965fcdee54a0f928c1dee1ac5d474 is deleted. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Marking volume 6a724267-404e-417a-8d23-0c8efba7115e as bootable. {{(pid=93769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Copying metadata from image f472f64e-f7ec-4170-b06c-8de073bddf2f to 6a724267-404e-417a-8d23-0c8efba7115e. {{(pid=93769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Creating volume glance metadata for volume 6a724267-404e-417a-8d23-0c8efba7115e backed by image f472f64e-f7ec-4170-b06c-8de073bddf2f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47062879-42b9-4317-a69b-7c5c2d25d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a724267-404e-417a-8d23-0c8efba7115e', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4515a5-4154-4c6a-a6db-bdb98f97f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:38 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Volume volume-6a724267-404e-417a-8d23-0c8efba7115e (6a724267-404e-417a-8d23-0c8efba7115e): created successfully Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4515a5-4154-4c6a-a6db-bdb98f97f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (175e2f90-5fd8-4b8c-a646-3f81faf34fc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5a3e38cb-9575-4132-879c-5907c4e5bb26 tempest-VolumesGetTest-1701178603 None] Created volume successfully. Jun 19 04:26:38 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (ef94b05a-5f55-4c55-aa47-2ab13432a6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd41c4c8-a11f-4aff-aee4-7728f0ed1005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd41c4c8-a11f-4aff-aee4-7728f0ed1005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341672695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1b4d23-79fe-403c-a8fb-a181c62cdf91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:39Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876d76be-cc9e-4f3d-afa9-6cff55db736f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (876d76be-cc9e-4f3d-afa9-6cff55db736f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3af56bf-7034-4429-b981-6d407f7849c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3af56bf-7034-4429-b981-6d407f7849c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c1b4d23-79fe-403c-a8fb-a181c62cdf91', 'volume_name': 'volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e0f83f-7a97-4333-b8ee-933e0631291a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71e0f83f-7a97-4333-b8ee-933e0631291a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b316b65-3c63-40da-a1c1-1d3b3fc878e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Volume 9c1b4d23-79fe-403c-a8fb-a181c62cdf91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91', 'volume_size': 1} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1341672695',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c1b4d23-79fe-403c-a8fb-a181c62cdf91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:39Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Creating volume 9c1b4d23-79fe-403c-a8fb-a181c62cdf91 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:39 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:39 devstack sudo[110380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 1073741824 Jun 19 04:26:39 devstack sudo[110380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (53c72749-881a-43cd-9c53-a800ea44fdea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a89ffe-1718-4ede-b251-30a18bad482f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3a89ffe-1718-4ede-b251-30a18bad482f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-323439084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88518f42-b78b-4a79-b90a-4d807dc1dae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:39Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50019439-5206-4b1a-b00b-8e1b3dcb3612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50019439-5206-4b1a-b00b-8e1b3dcb3612) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c32b9fc-2035-4af4-babc-5e735018277b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c32b9fc-2035-4af4-babc-5e735018277b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88518f42-b78b-4a79-b90a-4d807dc1dae5', 'volume_name': 'volume-88518f42-b78b-4a79-b90a-4d807dc1dae5', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c46f46-cede-4edc-91eb-e09fe6d10928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63c46f46-cede-4edc-91eb-e09fe6d10928) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634f92da-a583-429f-975e-06219ae7b9ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Volume 88518f42-b78b-4a79-b90a-4d807dc1dae5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88518f42-b78b-4a79-b90a-4d807dc1dae5', 'volume_size': 1} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (80cd7deb-102b-4426-89d0-8d1ab87c09bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b73a03-2717-4cac-b44c-fa061f90f4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b73a03-2717-4cac-b44c-fa061f90f4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157469640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:40Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b0d286-db0d-4a20-ae10-07a5d4f056a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2b0d286-db0d-4a20-ae10-07a5d4f056a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a677c68-6d7e-45b2-81ac-7e406b1be156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a677c68-6d7e-45b2-81ac-7e406b1be156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3', 'volume_name': 'volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0db260-cc9c-4459-8c87-13d973e44a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf0db260-cc9c-4459-8c87-13d973e44a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe124cc-f52f-4c3b-8134-fbbe2a4eda3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:39 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Volume 5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3', 'volume_size': 1} Jun 19 04:26:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (a35d2190-453f-4f31-a74a-60bf4937904a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85726df-a1e1-4178-851f-43f0b696d55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e85726df-a1e1-4178-851f-43f0b696d55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515963986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbed13b-2a73-46bd-bc0c-e086ee34df91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:40Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fbc8f0-539a-4f49-ab9a-08398eafa97c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26fbc8f0-539a-4f49-ab9a-08398eafa97c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe7e2a9-7eb1-450b-a28e-8bcca4ffbffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:40 devstack sudo[110380]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fe7e2a9-7eb1-450b-a28e-8bcca4ffbffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cbed13b-2a73-46bd-bc0c-e086ee34df91', 'volume_name': 'volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d649d9e-4004-42ce-a6c2-7b5c527adf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d649d9e-4004-42ce-a6c2-7b5c527adf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e40c89-ec9d-498c-ad99-11b7fbf078a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:40 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Volume 4cbed13b-2a73-46bd-bc0c-e086ee34df91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91', 'volume_size': 1} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 1073741824" returned: 0 in 1.257s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:40 devstack sudo[110386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 Jun 19 04:26:40 devstack sudo[110386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (22deb000-1f4f-4eda-83ac-958240c9fa87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18424754-43aa-4cef-9d4b-804b43c964cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18424754-43aa-4cef-9d4b-804b43c964cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-951596282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b5011d-236b-4684-86b9-efce80235436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:41Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d7f12a-7ca7-47e4-bec3-81443247a5be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5d7f12a-7ca7-47e4-bec3-81443247a5be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38cff04-90ed-4336-b5d1-cddf9824040c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f38cff04-90ed-4336-b5d1-cddf9824040c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '49b5011d-236b-4684-86b9-efce80235436', 'volume_name': 'volume-49b5011d-236b-4684-86b9-efce80235436', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e1dc4b-7cce-4ac9-b00e-8b508dd8c205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:40 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4e1dc4b-7cce-4ac9-b00e-8b508dd8c205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03de284-7257-45c7-af36-36fa7ac193fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:41 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Volume 49b5011d-236b-4684-86b9-efce80235436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-49b5011d-236b-4684-86b9-efce80235436', 'volume_size': 1} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (eaadc4e8-78fa-492b-8d21-5544d3ced445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75c87ab-b3cb-4851-87cf-cac198b547cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e75c87ab-b3cb-4851-87cf-cac198b547cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-652001390',display_name='tempest-VolumesGetTest-Volume-373719963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e43141b-87ff-4557-b6e2-d5863dffe117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:41Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878a3b23-da63-403b-801b-6d4a8899c81a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (878a3b23-da63-403b-801b-6d4a8899c81a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69298a06-f0b7-41e0-a218-80f168f4cb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (69298a06-f0b7-41e0-a218-80f168f4cb4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e43141b-87ff-4557-b6e2-d5863dffe117', 'volume_name': 'volume-8e43141b-87ff-4557-b6e2-d5863dffe117', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb57849-51d1-40af-a3bf-19f4aa49ee71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb57849-51d1-40af-a3bf-19f4aa49ee71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8f3f7d-5124-43b4-922e-41d21fc8bd1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:41 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Volume 8e43141b-87ff-4557-b6e2-d5863dffe117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e43141b-87ff-4557-b6e2-d5863dffe117', 'volume_size': 1} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:41 devstack sudo[110386]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91" returned: 0 in 0.727s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] <== create_volume: return (2033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.036s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.668s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-323439084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88518f42-b78b-4a79-b90a-4d807dc1dae5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:39Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Creating volume 88518f42-b78b-4a79-b90a-4d807dc1dae5 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:41 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:41 devstack sudo[110390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 1073741824 Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b316b65-3c63-40da-a1c1-1d3b3fc878e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:41 devstack sudo[110390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab2e46d-3674-4209-b6de-7e2a2dda81d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:41 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Volume volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 (9c1b4d23-79fe-403c-a8fb-a181c62cdf91): created successfully Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab2e46d-3674-4209-b6de-7e2a2dda81d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (ef94b05a-5f55-4c55-aa47-2ab13432a6b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ccd60793-98a6-49db-bb23-8897188b9fdc tempest-CreateVolumesFromImageTest-581880309 None] Created volume successfully. Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:41 devstack sudo[110397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:41 devstack sudo[110397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:42 devstack sudo[110390]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 1073741824" returned: 0 in 0.905s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:42 devstack sudo[110399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 Jun 19 04:26:42 devstack sudo[110399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:42 devstack sudo[110397]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.674s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:26:42 devstack sudo[110399]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5" returned: 0 in 0.681s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.633s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.909s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1157469640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:40Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Creating volume 5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:42 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:42 devstack sudo[110403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 1073741824 Jun 19 04:26:42 devstack sudo[110403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (634f92da-a583-429f-975e-06219ae7b9ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88518f42-b78b-4a79-b90a-4d807dc1dae5', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b594a1f-e2e6-4e3a-ac86-ee40bdaeae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:42 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Volume volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 (88518f42-b78b-4a79-b90a-4d807dc1dae5): created successfully Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b594a1f-e2e6-4e3a-ac86-ee40bdaeae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (53c72749-881a-43cd-9c53-a800ea44fdea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:42 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-26bb1e68-314b-4f61-8d19-1d10a263737c tempest-CreateVolumesFromImageTest-581880309 None] Created volume successfully. Jun 19 04:26:43 devstack sudo[110403]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 1073741824" returned: 0 in 0.951s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:43 devstack sudo[110410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 Jun 19 04:26:43 devstack sudo[110410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:44 devstack sudo[110410]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3" returned: 0 in 0.765s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.786s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.200s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1515963986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cbed13b-2a73-46bd-bc0c-e086ee34df91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:40Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Creating volume 4cbed13b-2a73-46bd-bc0c-e086ee34df91 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:44 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (efe124cc-f52f-4c3b-8134-fbbe2a4eda3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:44 devstack sudo[110413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 1073741824 Jun 19 04:26:44 devstack sudo[110413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac3d2a2-e49b-44d6-a0b8-2c72ef695fa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:44 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Volume volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 (5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3): created successfully Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ac3d2a2-e49b-44d6-a0b8-2c72ef695fa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (80cd7deb-102b-4426-89d0-8d1ab87c09bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-548f7697-875d-407e-8122-120b16ec82a2 tempest-CreateVolumesFromImageTest-581880309 None] Created volume successfully. Jun 19 04:26:45 devstack sudo[110413]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 1073741824" returned: 0 in 0.887s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:45 devstack sudo[110418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 Jun 19 04:26:45 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:46 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91" returned: 0 in 0.729s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.290s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-951596282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=49b5011d-236b-4684-86b9-efce80235436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d60f1fd77dc14b899bfbdd7973959118',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:41Z,use_quota=True,user_id='030d3a19a72441eca60fa02901b07db6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Creating volume 49b5011d-236b-4684-86b9-efce80235436 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:46 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e40c89-ec9d-498c-ad99-11b7fbf078a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:46 devstack sudo[110421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436 1073741824 Jun 19 04:26:46 devstack sudo[110421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b622443-014b-45d7-b80c-9e1986dfcbaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:46 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Volume volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 (4cbed13b-2a73-46bd-bc0c-e086ee34df91): created successfully Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b622443-014b-45d7-b80c-9e1986dfcbaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:46 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (a35d2190-453f-4f31-a74a-60bf4937904a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-be09bbed-8b33-43bb-a7a9-afe74a1cb7b3 tempest-CreateVolumesFromImageTest-581880309 None] Created volume successfully. Jun 19 04:26:47 devstack sudo[110421]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436 1073741824" returned: 0 in 0.947s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:47 devstack sudo[110427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436 Jun 19 04:26:47 devstack sudo[110427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:47 devstack sudo[110427]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436" returned: 0 in 0.664s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.664s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.823s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:41Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-652001390',display_name='tempest-VolumesGetTest-Volume-373719963',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e43141b-87ff-4557-b6e2-d5863dffe117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b2481f993ff4912831ebed8575e3b57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:41Z,use_quota=True,user_id='5db965fcdee54a0f928c1dee1ac5d474',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Creating volume 8e43141b-87ff-4557-b6e2-d5863dffe117 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:47 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:48 devstack sudo[110431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117 1073741824 Jun 19 04:26:48 devstack sudo[110431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03de284-7257-45c7-af36-36fa7ac193fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-49b5011d-236b-4684-86b9-efce80235436', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce5760e-4320-4373-a0c4-1fef2c661e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:48 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Volume volume-49b5011d-236b-4684-86b9-efce80235436 (49b5011d-236b-4684-86b9-efce80235436): created successfully Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ce5760e-4320-4373-a0c4-1fef2c661e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Flow 'volume_create_manager' (22deb000-1f4f-4eda-83ac-958240c9fa87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:48 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-113d1e4d-cda9-466f-893d-bbf6e6bbbf36 tempest-CreateVolumesFromImageTest-581880309 None] Created volume successfully. Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Flow 'volume_create_manager' (34720234-7b2a-4842-8690-187a7f2c2bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55995dce-b6a0-4dcd-97ee-e2e4898e5131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55995dce-b6a0-4dcd-97ee-e2e4898e5131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1202139177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30842a39-6e8c-4e38-a142-c394c0367a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8a90159d74d139216fdac6b2e3c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:48Z,use_quota=True,user_id='edd79f64b86e4fecb60c0381dd9c0daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2edaa13-917d-413b-ad83-919d9dd976a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2edaa13-917d-413b-ad83-919d9dd976a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30317a50-e898-41e8-bbfd-c566e1fd7d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30317a50-e898-41e8-bbfd-c566e1fd7d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30842a39-6e8c-4e38-a142-c394c0367a4a', 'volume_name': 'volume-30842a39-6e8c-4e38-a142-c394c0367a4a', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d23e5d-96cd-427b-b994-a2266fcf24bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89d23e5d-96cd-427b-b994-a2266fcf24bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf10777-c414-4abf-8280-b974e8166156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:48 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Volume 30842a39-6e8c-4e38-a142-c394c0367a4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30842a39-6e8c-4e38-a142-c394c0367a4a', 'volume_size': 1} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-49b5011d-236b-4684-86b9-efce80235436-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-49b5011d-236b-4684-86b9-efce80235436-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-quobyte-49b5011d-236b-4684-86b9-efce80235436" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-49b5011d-236b-4684-86b9-efce80235436" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e91023-cef0-4bcc-ad86-3d7e07e668aa]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:48 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436 Jun 19 04:26:48 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:48 devstack sudo[110431]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117 1073741824" returned: 0 in 0.925s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:48 devstack sudo[110439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117 Jun 19 04:26:48 devstack sudo[110439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:49 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436" returned: 0 in 0.869s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:49 devstack sudo[110444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436 Jun 19 04:26:49 devstack sudo[110444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:49 devstack sudo[110439]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117" returned: 0 in 0.626s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] <== create_volume: return (1611ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.619s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.396s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:26:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1202139177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30842a39-6e8c-4e38-a142-c394c0367a4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70e8a90159d74d139216fdac6b2e3c51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:26:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:26:48Z,use_quota=True,user_id='edd79f64b86e4fecb60c0381dd9c0daf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Creating volume 30842a39-6e8c-4e38-a142-c394c0367a4a {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:26:49 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:49 devstack sudo[110447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a 1073741824 Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c8f3f7d-5124-43b4-922e-41d21fc8bd1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e43141b-87ff-4557-b6e2-d5863dffe117', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:49 devstack sudo[110447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b176c829-67e0-4dd0-9221-e7c54c8a8f0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:49 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Volume volume-8e43141b-87ff-4557-b6e2-d5863dffe117 (8e43141b-87ff-4557-b6e2-d5863dffe117): created successfully Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b176c829-67e0-4dd0-9221-e7c54c8a8f0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Flow 'volume_create_manager' (eaadc4e8-78fa-492b-8d21-5544d3ced445) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:49 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-cfb5c759-fa76-4aae-ae6a-3841f5c0979b tempest-VolumesGetTest-1701178603 None] Created volume successfully. Jun 19 04:26:50 devstack sudo[110444]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-49b5011d-236b-4684-86b9-efce80235436" returned: 0 in 0.688s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-49b5011d-236b-4684-86b9-efce80235436" released by "delete_volume" :: held 1.605s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Created reservations ['d0b03ded-47ed-41ec-b7a3-2923badf60b0', '6519734f-9ab7-45c3-b357-ee1f77424921', '95b5a0bb-3385-4f9d-a5ac-527a6b300dc8', 'ccdfacf7-4ac0-4596-a585-72cad857a4de'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:50 devstack sudo[110453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:50 devstack sudo[110453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:50 devstack sudo[110447]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a 1073741824" returned: 0 in 0.880s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:50 devstack sudo[110456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a Jun 19 04:26:50 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-8e43141b-87ff-4557-b6e2-d5863dffe117-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Lock "cinder-8e43141b-87ff-4557-b6e2-d5863dffe117-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-quobyte-8e43141b-87ff-4557-b6e2-d5863dffe117" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-8e43141b-87ff-4557-b6e2-d5863dffe117" acquired by "delete_volume" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[131f932f-7f8c-491c-a6a4-b096cd322e12]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-4cbed13b-2a73-46bd-bc0c-e086ee34df91-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-4cbed13b-2a73-46bd-bc0c-e086ee34df91-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-quobyte-4cbed13b-2a73-46bd-bc0c-e086ee34df91" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-4cbed13b-2a73-46bd-bc0c-e086ee34df91" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd98f6ca-967c-4ec9-89a9-f9310499983e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:50 devstack sudo[110458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117 Jun 19 04:26:50 devstack sudo[110458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:51 devstack sudo[110459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 Jun 19 04:26:51 devstack sudo[110459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:51 devstack sudo[110453]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.724s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Deleted volume successfully. Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-da466cd4-d039-4e39-9deb-097e0c4d5735 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-49b5011d-236b-4684-86b9-efce80235436-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:51 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a" returned: 0 in 0.768s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] <== create_volume: return (1705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.708s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cf10777-c414-4abf-8280-b974e8166156) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30842a39-6e8c-4e38-a142-c394c0367a4a', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e384f5ed-19bf-411a-b790-d531bc8eb783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:26:51 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Volume volume-30842a39-6e8c-4e38-a142-c394c0367a4a (30842a39-6e8c-4e38-a142-c394c0367a4a): created successfully Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e384f5ed-19bf-411a-b790-d531bc8eb783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Flow 'volume_create_manager' (34720234-7b2a-4842-8690-187a7f2c2bdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:26:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a75d46ec-f25a-46ab-ab6e-e955b07fa815 tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Created volume successfully. Jun 19 04:26:51 devstack sudo[110458]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117" returned: 0 in 0.831s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:51 devstack sudo[110470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117 Jun 19 04:26:51 devstack sudo[110470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:51 devstack sudo[110459]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91" returned: 0 in 0.821s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:51 devstack sudo[110474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91 Jun 19 04:26:51 devstack sudo[110474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:52 devstack sudo[110470]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8e43141b-87ff-4557-b6e2-d5863dffe117" returned: 0 in 0.647s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-8e43141b-87ff-4557-b6e2-d5863dffe117" released by "delete_volume" :: held 1.539s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Created reservations ['faa184b2-fd2c-4970-87e1-fe11794176bb', 'baa685cb-2fee-48ed-a820-d38fe892ebbb', '3adb6240-d638-4562-b55f-14aaa8006ea9', '9922ec91-6a51-4e73-a2e2-c481082a65fa'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:52 devstack sudo[110474]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-4cbed13b-2a73-46bd-bc0c-e086ee34df91" returned: 0 in 0.642s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-4cbed13b-2a73-46bd-bc0c-e086ee34df91" released by "delete_volume" :: held 1.499s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:52 devstack sudo[110478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:52 devstack sudo[110478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Created reservations ['bd14704b-14fe-4084-bfb0-aedabcc30de7', '173dd29c-203d-4602-84a9-562973c19ebe', 'b1c575e7-c3fa-4cf6-8767-b4f73975bd31', '8f362b53-be09-445e-aae7-3200835a6a5d'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:52 devstack sudo[110480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:52 devstack sudo[110480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-6a724267-404e-417a-8d23-0c8efba7115e-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Lock "cinder-6a724267-404e-417a-8d23-0c8efba7115e-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Acquiring lock "cinder-quobyte-6a724267-404e-417a-8d23-0c8efba7115e" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-6a724267-404e-417a-8d23-0c8efba7115e" acquired by "delete_volume" :: waited 0.039s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:53 devstack sudo[110478]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.777s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:53 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Deleted volume successfully. Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e23837fa-13ad-4e28-813a-7c78a7fcf81d tempest-VolumesGetTest-1701178603 None] Lock "cinder-8e43141b-87ff-4557-b6e2-d5863dffe117-delete_volume" released by "delete_volume" :: held 2.565s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c626702-0d81-46bc-acc7-94d8131ecefd]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:53 devstack sudo[110480]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.724s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:53 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Deleted volume successfully. Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-quobyte-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-fb981123-87b5-4544-9d3d-baf0c9575d35 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-4cbed13b-2a73-46bd-bc0c-e086ee34df91-delete_volume" released by "delete_volume" :: held 2.487s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a8fe87-89bc-45e9-9974-9d1b8929265c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:53 devstack sudo[110484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e Jun 19 04:26:53 devstack sudo[110484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Acquiring lock "cinder-30842a39-6e8c-4e38-a142-c394c0367a4a-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "cinder-30842a39-6e8c-4e38-a142-c394c0367a4a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:53 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 Jun 19 04:26:53 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Acquiring lock "cinder-quobyte-30842a39-6e8c-4e38-a142-c394c0367a4a" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "cinder-quobyte-30842a39-6e8c-4e38-a142-c394c0367a4a" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[14f93dc2-338b-4604-860b-0fd93c1a9668]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:53 devstack sudo[110488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a Jun 19 04:26:53 devstack sudo[110488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:54 devstack sudo[110484]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e" returned: 0 in 0.836s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:54 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3" returned: 0 in 0.855s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:54 devstack sudo[110495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e Jun 19 04:26:54 devstack sudo[110495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:54 devstack sudo[110498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3 Jun 19 04:26:54 devstack sudo[110498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:54 devstack sudo[110488]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a" returned: 0 in 0.822s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:54 devstack sudo[110502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a Jun 19 04:26:54 devstack sudo[110502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:54 devstack sudo[110495]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e" returned: 1 in 0.789s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:54 devstack sudo[110498]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3" returned: 0 in 0.689s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:54 devstack sudo[110514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e Jun 19 04:26:54 devstack sudo[110514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3" released by "delete_volume" :: held 1.594s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:54 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Created reservations ['9d446561-7c6d-4baf-99fd-0aa8e4f96c53', '5cecc8e7-ea27-4e38-87d5-b43b14913d9f', '5c354dec-6043-43aa-84fd-82c9801aac05', 'c858aebc-79f2-4941-a7a7-0efdde470283'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:55 devstack sudo[110517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:55 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:55 devstack sudo[110502]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-30842a39-6e8c-4e38-a142-c394c0367a4a" returned: 0 in 0.751s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "cinder-quobyte-30842a39-6e8c-4e38-a142-c394c0367a4a" released by "delete_volume" :: held 1.624s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Created reservations ['e8d07b3d-2092-49db-836e-4b594c009798', '2924529d-1382-4158-a0b9-9a5ccae2dc00', '8e13ce05-ae43-47dc-b41d-e563ebee6e86', '546f9694-5478-449e-81f4-d0278d92fc32'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:55 devstack sudo[110519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:55 devstack sudo[110519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-88518f42-b78b-4a79-b90a-4d807dc1dae5-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-88518f42-b78b-4a79-b90a-4d807dc1dae5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-quobyte-88518f42-b78b-4a79-b90a-4d807dc1dae5" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-88518f42-b78b-4a79-b90a-4d807dc1dae5" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d694b0-0791-4ad2-97d1-23b4c41b42e1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:55 devstack sudo[110514]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a724267-404e-417a-8d23-0c8efba7115e" returned: 0 in 0.765s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Lock "cinder-quobyte-6a724267-404e-417a-8d23-0c8efba7115e" released by "delete_volume" :: held 2.518s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:55 devstack sudo[110522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 Jun 19 04:26:55 devstack sudo[110522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Created reservations ['60ddd023-5e42-4691-a129-323d84c48fa8', '88d10675-8d9c-4ae6-9c64-9fbd48fa96bd', 'd76d50e9-5b26-4aba-a06a-6130a7fdcb01', 'b4792cb5-1929-4491-97c2-4aebf4ec1490'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:55 devstack sudo[110525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:55 devstack sudo[110525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:55 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.936s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:55 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:55 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Deleted volume successfully. Jun 19 04:26:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c0a01fe-e7ea-4e21-b171-41656152e0e8 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-5980cd00-86e3-44f0-8ffc-bdd5c2c9d1e3-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:56 devstack sudo[110519]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.810s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:56 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Deleted volume successfully. Jun 19 04:26:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-98d10019-1ade-4e6f-b996-1e1c5444c73f tempest-VolumeQuotasNegativeTestJSON-1051385602 None] Lock "cinder-30842a39-6e8c-4e38-a142-c394c0367a4a-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:56 devstack sudo[110522]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5" returned: 0 in 1.039s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:56 devstack sudo[110532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5 Jun 19 04:26:56 devstack sudo[110532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:56 devstack sudo[110525]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.812s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:56 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Deleted volume successfully. Jun 19 04:26:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d1fab20-1971-48b3-8e90-a8b8c4d0b363 tempest-VolumesGetTest-1701178603 None] Lock "cinder-6a724267-404e-417a-8d23-0c8efba7115e-delete_volume" released by "delete_volume" :: held 3.692s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:57 devstack sudo[110532]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-88518f42-b78b-4a79-b90a-4d807dc1dae5" returned: 0 in 0.789s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-88518f42-b78b-4a79-b90a-4d807dc1dae5" released by "delete_volume" :: held 1.896s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Created reservations ['756b3555-8c3d-4a51-93c6-8cf90763d8ce', '032704f7-496a-4683-83ab-0bcb8050426c', '382e4755-1e24-45ae-b6d5-1a85db577180', '9620fb1d-77ac-481c-a99d-dea0434a2889'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:57 devstack sudo[110535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:57 devstack sudo[110535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-9c1b4d23-79fe-403c-a8fb-a181c62cdf91-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-9c1b4d23-79fe-403c-a8fb-a181c62cdf91-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "cinder-quobyte-9c1b4d23-79fe-403c-a8fb-a181c62cdf91" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-9c1b4d23-79fe-403c-a8fb-a181c62cdf91" acquired by "delete_volume" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2fad115-9045-465b-99ce-e4160d228803]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:26:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:58 devstack sudo[110537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 Jun 19 04:26:58 devstack sudo[110537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:58 devstack sudo[110535]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.970s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:58 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:26:58 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Deleted volume successfully. Jun 19 04:26:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3de20c90-8042-46ff-989b-72ad026b1062 tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-88518f42-b78b-4a79-b90a-4d807dc1dae5-delete_volume" released by "delete_volume" :: held 3.152s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:58 devstack sudo[110537]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91" returned: 0 in 0.961s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:58 devstack sudo[110543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91 Jun 19 04:26:58 devstack sudo[110543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:26:59 devstack sudo[110543]: pam_unix(sudo:session): session closed for user root Jun 19 04:26:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9c1b4d23-79fe-403c-a8fb-a181c62cdf91" returned: 0 in 0.664s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:26:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-quobyte-9c1b4d23-79fe-403c-a8fb-a181c62cdf91" released by "delete_volume" :: held 1.686s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:26:59 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Created reservations ['09665b38-8112-455f-9b96-466991c01f06', 'c6b37fc6-a11b-4521-91c9-e5c2ec20b109', '1b7a47ae-d7b5-4291-8a66-c40141d5141d', '9e3f6adf-3c3a-4c15-99c5-5eab40acc460'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:26:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:26:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:26:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:26:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:26:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:26:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:26:59 devstack sudo[110546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:26:59 devstack sudo[110546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Flow 'volume_create_manager' (5c8fb7d7-5142-4640-aedc-bafd28a65f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24480194-8963-44e8-a931-b46630e17d51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24480194-8963-44e8-a931-b46630e17d51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-306464956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9634d57b4fc34bae8adbb1d4ac7cf518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:00Z,use_quota=True,user_id='b75f5df148cc48abab60670a31bae2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee821a3-d196-4191-8dd0-d7beb8cca93e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ee821a3-d196-4191-8dd0-d7beb8cca93e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d20c26-a330-4d82-acaf-851edaf4a16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10d20c26-a330-4d82-acaf-851edaf4a16b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5', 'volume_name': 'volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ed1e0d-0dde-433a-b618-3d136a411f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77ed1e0d-0dde-433a-b618-3d136a411f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65be8de-36c9-454b-9097-c6906fd24c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:00 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Volume b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5', 'volume_size': 1} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-306464956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9634d57b4fc34bae8adbb1d4ac7cf518',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:00Z,use_quota=True,user_id='b75f5df148cc48abab60670a31bae2fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Creating volume b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:00 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:00 devstack sudo[110548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 1073741824 Jun 19 04:27:00 devstack sudo[110548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:00 devstack sudo[110546]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.774s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:00 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Deleted volume successfully. Jun 19 04:27:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9a90a7b-e5e6-4301-a5da-d0bea44720fe tempest-CreateVolumesFromImageTest-581880309 None] Lock "cinder-9c1b4d23-79fe-403c-a8fb-a181c62cdf91-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:01 devstack sudo[110548]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 1073741824" returned: 0 in 1.016s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:01 devstack sudo[110555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 Jun 19 04:27:01 devstack sudo[110555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:01 devstack sudo[110555]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" returned: 0 in 0.731s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] <== create_volume: return (1801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65be8de-36c9-454b-9097-c6906fd24c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dc347c-866a-43cc-9583-174e73a83049) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:02 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Volume volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 (b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5): created successfully Jun 19 04:27:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1dc347c-866a-43cc-9583-174e73a83049) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Flow 'volume_create_manager' (5c8fb7d7-5142-4640-aedc-bafd28a65f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-8a76677c-0f05-4482-94b0-ded5a872e877 tempest-VolumesSnapshotListTestJSON-85145183 None] Created volume successfully. Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Creating offline snapshot fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 of volume b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Flow 'volume_create_manager' (3ff7f732-b025-40b2-a48d-f53c92cc9cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e045edaf-f4de-4608-b772-16896db79cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca88fb70-6294-4297-928e-4a1cad58ef69]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e045edaf-f4de-4608-b772-16896db79cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1045392693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e2b142-b137-49a0-ad9a-3f595e6fda22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2a823f80c9476e811f74e5df2fa754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:04Z,use_quota=True,user_id='1b09d660d4c7461e8a995c373ad0ffbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec0f93e-b584-4166-bd56-616e5629e981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ec0f93e-b584-4166-bd56-616e5629e981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec9acab-0cdc-478c-830e-d9be9b0b39ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ec9acab-0cdc-478c-830e-d9be9b0b39ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1e2b142-b137-49a0-ad9a-3f595e6fda22', 'volume_name': 'volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d5e0d0-8daa-4f86-a83f-dadab9a986ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8d5e0d0-8daa-4f86-a83f-dadab9a986ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b565936b-bd0b-4eb7-9043-652ff2e54970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:03 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Volume c1e2b142-b137-49a0-ad9a-3f595e6fda22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22', 'volume_size': 1} Jun 19 04:27:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:03 devstack sudo[110559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 Jun 19 04:27:03 devstack sudo[110559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:04 devstack sudo[110559]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" returned: 0 in 0.817s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:04 devstack sudo[110565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 1G Jun 19 04:27:04 devstack sudo[110565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:05 devstack sudo[110565]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 1G" returned: 0 in 0.813s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:05 devstack sudo[110575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 Jun 19 04:27:05 devstack sudo[110575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:05 devstack sudo[110575]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" returned: 0 in 0.695s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:05 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 is being set with open permissions: ugo+rw Jun 19 04:27:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:05 devstack sudo[110580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 Jun 19 04:27:05 devstack sudo[110580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:06 devstack sudo[110580]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" returned: 0 in 0.644s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:06 devstack sudo[110583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.info Jun 19 04:27:06 devstack sudo[110583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:07 devstack sudo[110583]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Flow 'volume_create_manager' (ff8988e6-eb7d-4d08-ac38-657ca88814bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8fa108-087c-4b7f-9833-62b7f690482c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.info" returned: 0 in 0.671s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:07 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.info is being set with open permissions: ugo+rw Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:07 devstack sudo[110586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.info Jun 19 04:27:07 devstack sudo[110586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae8fa108-087c-4b7f-9833-62b7f690482c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-281473885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b153bf-986d-4fab-b9fd-56b77231e088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609a50d8dd2142e6b3c6a2a579e0a922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:07Z,use_quota=True,user_id='506501b08d4f490a84b211eb75f4459f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de14e5f1-505b-4aa1-b3c2-115dc3a0b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de14e5f1-505b-4aa1-b3c2-115dc3a0b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3c6bf5-2d72-42dc-9404-c2ffe3c80081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd3c6bf5-2d72-42dc-9404-c2ffe3c80081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b153bf-986d-4fab-b9fd-56b77231e088', 'volume_name': 'volume-45b153bf-986d-4fab-b9fd-56b77231e088', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3bf4b0-f578-441b-98d5-968d791d2708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc3bf4b0-f578-441b-98d5-968d791d2708) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e0bcd0-307e-43ea-8670-6eb321717c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:07 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Volume 45b153bf-986d-4fab-b9fd-56b77231e088: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b153bf-986d-4fab-b9fd-56b77231e088', 'volume_size': 1} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:07 devstack sudo[110586]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.info" returned: 0 in 0.603s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.359s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.223s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1045392693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1e2b142-b137-49a0-ad9a-3f595e6fda22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2a823f80c9476e811f74e5df2fa754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:04Z,use_quota=True,user_id='1b09d660d4c7461e8a995c373ad0ffbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Creating volume c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:07 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:27:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:07 devstack sudo[110589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 1073741824 Jun 19 04:27:07 devstack sudo[110589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:07 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f2462976-d8ad-47df-8b8d-ddeb68428790 tempest-VolumesSnapshotListTestJSON-85145183 None] Create snapshot completed successfully Jun 19 04:27:08 devstack sudo[110589]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 1073741824" returned: 0 in 0.836s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:08 devstack sudo[110595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 Jun 19 04:27:08 devstack sudo[110595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:09 devstack sudo[110595]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22" returned: 0 in 0.601s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.041s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-281473885',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b153bf-986d-4fab-b9fd-56b77231e088,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609a50d8dd2142e6b3c6a2a579e0a922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:07Z,use_quota=True,user_id='506501b08d4f490a84b211eb75f4459f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Creating volume 45b153bf-986d-4fab-b9fd-56b77231e088 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:09 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b565936b-bd0b-4eb7-9043-652ff2e54970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:09 devstack sudo[110598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088 1073741824 Jun 19 04:27:09 devstack sudo[110598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32fba85-b45c-45b9-8059-8ef4f75f0ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:09 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Volume volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 (c1e2b142-b137-49a0-ad9a-3f595e6fda22): created successfully Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a32fba85-b45c-45b9-8059-8ef4f75f0ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Flow 'volume_create_manager' (3ff7f732-b025-40b2-a48d-f53c92cc9cb3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:09 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-83f34990-40b8-4b98-8675-a6e321e85c7e tempest-VolumeDependencyTests-1922823037 None] Created volume successfully. Jun 19 04:27:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:10 devstack sudo[110598]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088 1073741824" returned: 0 in 0.788s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:10 devstack sudo[110604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088 Jun 19 04:27:10 devstack sudo[110604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:10 devstack sudo[110604]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088" returned: 0 in 0.617s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.072s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Creating offline snapshot 4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 of volume b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54e0bcd0-307e-43ea-8670-6eb321717c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b153bf-986d-4fab-b9fd-56b77231e088', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbf57c2-1147-4b14-9ce7-023dbe31ddb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d634870-15e0-44d2-b3db-44ac0c401391]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:10 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Volume volume-45b153bf-986d-4fab-b9fd-56b77231e088 (45b153bf-986d-4fab-b9fd-56b77231e088): created successfully Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbbf57c2-1147-4b14-9ce7-023dbe31ddb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Flow 'volume_create_manager' (ff8988e6-eb7d-4d08-ac38-657ca88814bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:10 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-247857b9-debc-42b1-a75a-74c6539942d8 tempest-VolumesListAdminTestJSON-543760841 None] Created volume successfully. Jun 19 04:27:11 devstack sudo[110607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 Jun 19 04:27:11 devstack sudo[110607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:11 devstack sudo[110607]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" returned: 0 in 0.759s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:11 devstack sudo[110613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 1G Jun 19 04:27:11 devstack sudo[110613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Flow 'volume_create_manager' (dcd6b35f-ae5f-429e-ba33-6910445f6220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858e0280-f3b5-4720-81cd-245978ac4a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (858e0280-f3b5-4720-81cd-245978ac4a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-64107904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fda611-5bba-4fc4-b3ed-ac280f09b664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609a50d8dd2142e6b3c6a2a579e0a922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:12Z,use_quota=True,user_id='506501b08d4f490a84b211eb75f4459f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3c0064-8f21-45e8-9937-a1e7f9002e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e3c0064-8f21-45e8-9937-a1e7f9002e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47aa8ce-06ec-4294-993e-66318b88ac07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a47aa8ce-06ec-4294-993e-66318b88ac07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0fda611-5bba-4fc4-b3ed-ac280f09b664', 'volume_name': 'volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de85a017-f2ba-4bdc-b6ad-23e53d7f8bc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de85a017-f2ba-4bdc-b6ad-23e53d7f8bc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fdb4d3-3dc2-4b79-b89f-c7762e409e46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:12 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Volume b0fda611-5bba-4fc4-b3ed-ac280f09b664: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664', 'volume_size': 1} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:12 devstack sudo[110613]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 1G" returned: 0 in 0.820s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:12 devstack sudo[110619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 Jun 19 04:27:12 devstack sudo[110619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:13 devstack sudo[110619]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" returned: 0 in 0.680s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:13 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 is being set with open permissions: ugo+rw Jun 19 04:27:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:13 devstack sudo[110660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 Jun 19 04:27:13 devstack sudo[110660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:13 devstack sudo[110660]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" returned: 0 in 0.604s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:13 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=187,cinder:SELECT=126,cinder:DELETE=13,cinder:INSERT=47 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:27:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.960s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.877s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:13 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Creating offline snapshot 13bf1603-95ec-4c29-90fe-1607c984d013 of volume c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:27:13 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[856e9b96-5915-4a6e-846f-c2494a56bcb6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:13 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-fa39d1f1-9241-42c6-af54-0d17e3c32fd0 tempest-VolumesSnapshotListTestJSON-85145183 None] Create snapshot completed successfully Jun 19 04:27:13 devstack sudo[110663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 Jun 19 04:27:13 devstack sudo[110663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:14 devstack sudo[110663]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22" returned: 0 in 0.733s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:14 devstack sudo[110668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 1G Jun 19 04:27:14 devstack sudo[110668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:15 devstack sudo[110668]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 1G" returned: 0 in 0.761s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:15 devstack sudo[110673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 Jun 19 04:27:15 devstack sudo[110673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:16 devstack sudo[110673]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013" returned: 0 in 0.639s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:16 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 is being set with open permissions: ugo+rw Jun 19 04:27:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:16 devstack sudo[110678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 Jun 19 04:27:16 devstack sudo[110678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:16 devstack sudo[110678]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013" returned: 0 in 0.597s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:16 devstack sudo[110681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.info Jun 19 04:27:16 devstack sudo[110681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:17 devstack sudo[110681]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.info" returned: 0 in 0.638s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:17 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.info is being set with open permissions: ugo+rw Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:17 devstack sudo[110684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.info Jun 19 04:27:17 devstack sudo[110684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:17 devstack sudo[110684]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.info" returned: 0 in 0.603s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.057s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.854s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-64107904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0fda611-5bba-4fc4-b3ed-ac280f09b664,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609a50d8dd2142e6b3c6a2a579e0a922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:12Z,use_quota=True,user_id='506501b08d4f490a84b211eb75f4459f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Creating volume b0fda611-5bba-4fc4-b3ed-ac280f09b664 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:17 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:27:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:17 devstack sudo[110687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 1073741824 Jun 19 04:27:17 devstack sudo[110687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:17 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-662182e5-7833-49f9-87e3-26c720dd9490 tempest-VolumeDependencyTests-1922823037 None] Create snapshot completed successfully Jun 19 04:27:18 devstack sudo[110687]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 1073741824" returned: 0 in 0.832s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:18 devstack sudo[110693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 Jun 19 04:27:18 devstack sudo[110693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Flow 'volume_create_manager' (89203778-8f2d-459a-bd9b-f162597503ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b50d7-8b9e-4975-85c7-0224375db9e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (612b50d7-8b9e-4975-85c7-0224375db9e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-332336642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8c2a823f80c9476e811f74e5df2fa754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=13bf1603-95ec-4c29-90fe-1607c984d013,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:19Z,use_quota=True,user_id='1b09d660d4c7461e8a995c373ad0ffbb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef68543-ec7a-4476-8c44-7fc5925aa7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef68543-ec7a-4476-8c44-7fc5925aa7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e54104-867a-4ae9-87cf-b411c6d598e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45e54104-867a-4ae9-87cf-b411c6d598e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc', 'volume_name': 'volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc', 'volume_size': 1, 'snapshot_id': '13bf1603-95ec-4c29-90fe-1607c984d013'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991ffb6b-b598-4bae-b35f-293ea10d3d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (991ffb6b-b598-4bae-b35f-293ea10d3d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93f38c1-32d5-4ee2-afdf-1a026ece0dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:18 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Volume 12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc', 'volume_size': 1, 'snapshot_id': '13bf1603-95ec-4c29-90fe-1607c984d013'} Jun 19 04:27:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:19 devstack sudo[110693]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664" returned: 0 in 0.631s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.237s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1fdb4d3-3dc2-4b79-b89f-c7762e409e46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd52807f-67b8-49d6-be56-d1535449c7d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Creating offline snapshot 021ffe8b-e548-42a6-ad96-df6cb7284835 of volume b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:27:19 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Volume volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 (b0fda611-5bba-4fc4-b3ed-ac280f09b664): created successfully Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd52807f-67b8-49d6-be56-d1535449c7d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Flow 'volume_create_manager' (dcd6b35f-ae5f-429e-ba33-6910445f6220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[464e2171-6206-4a4c-8f0b-0a5b3e597bd1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:19 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-35bf0e23-e885-4993-8e5a-6f3e050ab6fa tempest-VolumesListAdminTestJSON-543760841 None] Created volume successfully. Jun 19 04:27:19 devstack sudo[110696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 Jun 19 04:27:19 devstack sudo[110696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:20 devstack sudo[110696]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" returned: 0 in 0.718s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:20 devstack sudo[110701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 1G Jun 19 04:27:20 devstack sudo[110701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Flow 'volume_create_manager' (2a659337-f970-4d10-ac92-c0b7239d4ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b89eae-e5bf-4fde-99d7-d202b1370d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54b89eae-e5bf-4fde-99d7-d202b1370d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1364542703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d83563-236b-4dfa-aabc-e4ec9cca15be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609a50d8dd2142e6b3c6a2a579e0a922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:21Z,use_quota=True,user_id='506501b08d4f490a84b211eb75f4459f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67ed757-471b-4041-b9c9-4ef705b435a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67ed757-471b-4041-b9c9-4ef705b435a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f39168b-a6da-4bc2-a77f-390ac78b1dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f39168b-a6da-4bc2-a77f-390ac78b1dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9d83563-236b-4dfa-aabc-e4ec9cca15be', 'volume_name': 'volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae273051-3565-43d2-946e-1ced28c35347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae273051-3565-43d2-946e-1ced28c35347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55a5a2a-daa6-4ef4-91d9-fc97ea3c397e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:20 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Volume e9d83563-236b-4dfa-aabc-e4ec9cca15be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be', 'volume_size': 1} Jun 19 04:27:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:21 devstack sudo[110701]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 1G" returned: 0 in 0.840s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:21 devstack sudo[110707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 Jun 19 04:27:21 devstack sudo[110707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:21 devstack sudo[110707]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835" returned: 0 in 0.648s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:21 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 is being set with open permissions: ugo+rw Jun 19 04:27:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:21 devstack sudo[110713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 Jun 19 04:27:21 devstack sudo[110713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:22 devstack sudo[110713]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835" returned: 0 in 0.605s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.928s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.425s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "cinder-quobyte-13bf1603-95ec-4c29-90fe-1607c984d013-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" by "_create_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-13bf1603-95ec-4c29-90fe-1607c984d013-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Creating volume 12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc from snapshot 13bf1603-95ec-4c29-90fe-1607c984d013 {{(pid=93769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "cinder-quobyte-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-de40cef7-457d-4bb0-bd8f-fe6e781cfa5d tempest-VolumesSnapshotListTestJSON-85145183 None] Create snapshot completed successfully Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] snapshot: 13bf1603-95ec-4c29-90fe-1607c984d013, volume: 12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[956ee72f-747c-4d0b-a3c8-308163ee2245]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:22 devstack sudo[110716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 Jun 19 04:27:22 devstack sudo[110716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:23 devstack sudo[110716]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-021ffe8b-e548-42a6-ad96-df6cb7284835-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013" returned: 0 in 0.753s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f563ed-e5e0-408a-9987-79ed3330188a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-021ffe8b-e548-42a6-ad96-df6cb7284835-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" acquired by "delete_snapshot" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-quobyte-021ffe8b-e548-42a6-ad96-df6cb7284835" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-021ffe8b-e548-42a6-ad96-df6cb7284835" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Deleting offline snapshot 021ffe8b-e548-42a6-ad96-df6cb7284835 of volume b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] snapshot_file for this snap is: volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[caf3a96f-f059-4370-8b5f-16502ff4c0d9]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:23 devstack sudo[110721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 Jun 19 04:27:23 devstack sudo[110721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:23 devstack sudo[110722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 Jun 19 04:27:23 devstack sudo[110722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:24 devstack sudo[110721]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22" returned: 0 in 0.804s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:24 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:27:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:24 devstack sudo[110731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc Jun 19 04:27:24 devstack sudo[110731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:24 devstack sudo[110722]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835" returned: 0 in 0.788s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a10e68-30d5-4278-a629-df6fd30fdfdb]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:24 devstack sudo[110733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 Jun 19 04:27:24 devstack sudo[110733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:25 devstack sudo[110733]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" returned: 0 in 0.942s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:25 devstack sudo[110748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 Jun 19 04:27:25 devstack sudo[110748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:26 devstack sudo[110748]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835" returned: 0 in 1.469s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:26 devstack sudo[110754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835 Jun 19 04:27:26 devstack sudo[110754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:27 devstack sudo[110754]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.021ffe8b-e548-42a6-ad96-df6cb7284835" returned: 0 in 1.410s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-021ffe8b-e548-42a6-ad96-df6cb7284835" released by "_delete_snapshot" :: held 4.740s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" released by "delete_snapshot" :: held 4.775s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Created reservations ['c75fb3c3-e62a-436d-8e1b-89ec05cb4324', '93bad70d-0c9d-4f19-992a-b80c0b8d49b6', '27cb0234-0b6b-46aa-9f46-a54b22c0c0f5', 'dd0f1127-6381-4b5f-a765-8844469b140c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Delete snapshot completed successfully. Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-38d92f94-e168-485f-b6ce-b106a0ec44a8 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-021ffe8b-e548-42a6-ad96-df6cb7284835-delete_snapshot" released by "delete_snapshot" :: held 5.051s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-4a7dcebd-b40c-4462-bafe-83bc1d65b3e0-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-4a7dcebd-b40c-4462-bafe-83bc1d65b3e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" acquired by "delete_snapshot" :: waited 0.037s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-quobyte-4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Deleting offline snapshot 4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 of volume b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] snapshot_file for this snap is: volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7b460c-32a1-41db-ad9b-7c7c7056cdf8]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:28 devstack sudo[110757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 Jun 19 04:27:28 devstack sudo[110757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:29 devstack sudo[110731]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" returned: 0 in 5.002s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:29 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f8a3d5-05bb-4b00-9f44-3d70ac6b61bf]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:29 devstack sudo[110759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 Jun 19 04:27:29 devstack sudo[110759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:29 devstack sudo[110757]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" returned: 0 in 0.752s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:29 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:29 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfaa352f-d515-4f11-bc4c-29fa530e9eaa]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:29 devstack sudo[110764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 Jun 19 04:27:29 devstack sudo[110764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:30 devstack sudo[110759]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22" returned: 0 in 0.974s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22, size 1024.00 MB, duration 5.00 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:27:30 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Converted 1024.00 MB image at 204.65 MB/s Jun 19 04:27:30 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc is being set with open permissions: ugo+rw Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:30 devstack sudo[110769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc Jun 19 04:27:30 devstack sudo[110769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:30 devstack sudo[110764]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" returned: 0 in 0.733s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:30 devstack sudo[110774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 Jun 19 04:27:30 devstack sudo[110774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:30 devstack sudo[110769]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" returned: 0 in 0.634s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" released by "_copy_volume_from_snapshot" :: held 8.286s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-13bf1603-95ec-4c29-90fe-1607c984d013-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" released by "_create_volume_from_snapshot" :: held 8.318s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.337s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.736s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1364542703',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d83563-236b-4dfa-aabc-e4ec9cca15be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='609a50d8dd2142e6b3c6a2a579e0a922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:21Z,use_quota=True,user_id='506501b08d4f490a84b211eb75f4459f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Creating volume e9d83563-236b-4dfa-aabc-e4ec9cca15be {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:30 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:30 devstack sudo[110777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be 1073741824 Jun 19 04:27:30 devstack sudo[110777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a93f38c1-32d5-4ee2-afdf-1a026ece0dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc', 'volume_size': 1, 'snapshot_id': '13bf1603-95ec-4c29-90fe-1607c984d013'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25cf726-6c74-404c-8ebf-b18783bb0f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:30 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Volume volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc (12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc): created successfully Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25cf726-6c74-404c-8ebf-b18783bb0f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Flow 'volume_create_manager' (89203778-8f2d-459a-bd9b-f162597503ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:30 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-71839e73-4ee4-4891-897b-3f73bf5970b1 tempest-VolumeDependencyTests-1922823037 None] Created volume successfully. Jun 19 04:27:31 devstack sudo[110774]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" returned: 0 in 0.737s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:31 devstack sudo[110783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0 Jun 19 04:27:31 devstack sudo[110783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:31 devstack sudo[110777]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be 1073741824" returned: 0 in 0.885s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:31 devstack sudo[110789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be Jun 19 04:27:31 devstack sudo[110789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:31 devstack sudo[110783]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" returned: 0 in 0.627s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-4a7dcebd-b40c-4462-bafe-83bc1d65b3e0" released by "_delete_snapshot" :: held 2.996s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" released by "delete_snapshot" :: held 3.038s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "cinder-13bf1603-95ec-4c29-90fe-1607c984d013-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-13bf1603-95ec-4c29-90fe-1607c984d013-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "cinder-quobyte-c1e2b142-b137-49a0-ad9a-3f595e6fda22" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-c1e2b142-b137-49a0-ad9a-3f595e6fda22" acquired by "delete_snapshot" :: waited 0.041s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "cinder-quobyte-13bf1603-95ec-4c29-90fe-1607c984d013" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Created reservations ['0ba108c0-f64f-4ee8-b124-228c6424d074', '7edb0a76-09c5-4db7-b11a-fa2096027c6a', '69709597-3bcc-4d17-9b37-fcfe1a7f35c8', '1115b547-9c4a-4700-974a-69d932c8d5a2'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-13bf1603-95ec-4c29-90fe-1607c984d013" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Deleting offline snapshot 13bf1603-95ec-4c29-90fe-1607c984d013 of volume c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] snapshot_file for this snap is: volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d20ad9dc-24a3-46ba-b229-9c4873743e9b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:31 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Delete snapshot completed successfully. Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-cbed08d3-cfc5-4c1e-aaac-c8717d145221 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-4a7dcebd-b40c-4462-bafe-83bc1d65b3e0-delete_snapshot" released by "delete_snapshot" :: held 3.297s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:32 devstack sudo[110792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 Jun 19 04:27:32 devstack sudo[110792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:32 devstack sudo[110789]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be" returned: 0 in 0.647s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b55a5a2a-daa6-4ef4-91d9-fc97ea3c397e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3c14cf-3c99-4d06-ba97-374b6cfc55a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:32 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Volume volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be (e9d83563-236b-4dfa-aabc-e4ec9cca15be): created successfully Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b3c14cf-3c99-4d06-ba97-374b6cfc55a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Flow 'volume_create_manager' (2a659337-f970-4d10-ac92-c0b7239d4ce6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:32 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b42a4e6a-07be-4da3-95b0-09854834394b tempest-VolumesListAdminTestJSON-543760841 None] Created volume successfully. Jun 19 04:27:32 devstack sudo[110792]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013" returned: 0 in 0.759s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[82cbde38-5879-4e53-b807-534f2fa67296]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:32 devstack sudo[110798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 Jun 19 04:27:32 devstack sudo[110798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:32 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-fcec6ab8-2ba5-401c-9e5a-c6dff2191a66-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-fcec6ab8-2ba5-401c-9e5a-c6dff2191a66-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-quobyte-fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Deleting offline snapshot fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 of volume b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] snapshot_file for this snap is: volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[97396656-abbf-4a9a-9d71-73de45ff0d2e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:33 devstack sudo[110800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 Jun 19 04:27:33 devstack sudo[110800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Flow 'volume_create_manager' (1b9cb177-4df9-462b-939b-e60cdba9f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6164870-32fb-4d7a-b3dc-f34e4ad5d576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6164870-32fb-4d7a-b3dc-f34e4ad5d576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1b5906-2314-4a0d-9546-ca7c11ad01af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48516d1b66bf4999b017cdc5bd17dbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:33Z,use_quota=True,user_id='e0f2e283aa5c49af88d9bae7c036995c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26ef03d-f631-49cb-b8c0-2e791f13087e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f26ef03d-f631-49cb-b8c0-2e791f13087e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503a5dc9-a638-4712-927a-dce7aa699070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (503a5dc9-a638-4712-927a-dce7aa699070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a1b5906-2314-4a0d-9546-ca7c11ad01af', 'volume_name': 'volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69b7331-085c-43f2-85f7-c2f9746147df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f69b7331-085c-43f2-85f7-c2f9746147df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcff37d7-7306-49f7-9f56-eaf9f67fd2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:33 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Volume 6a1b5906-2314-4a0d-9546-ca7c11ad01af: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af', 'volume_size': 1} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:33Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a1b5906-2314-4a0d-9546-ca7c11ad01af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='48516d1b66bf4999b017cdc5bd17dbe3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:33Z,use_quota=True,user_id='e0f2e283aa5c49af88d9bae7c036995c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Creating volume 6a1b5906-2314-4a0d-9546-ca7c11ad01af {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:33 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:33 devstack sudo[110805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af 1073741824 Jun 19 04:27:33 devstack sudo[110805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:33 devstack sudo[110798]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22" returned: 0 in 0.841s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:33 devstack sudo[110807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 Jun 19 04:27:33 devstack sudo[110807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:33 devstack sudo[110800]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" returned: 0 in 0.800s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a2dd91d-e22e-4225-9333-976f9f743ab9]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:34 devstack sudo[110812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 Jun 19 04:27:34 devstack sudo[110812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:34 devstack sudo[110807]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013" returned: 0 in 0.767s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:34 devstack sudo[110820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013 Jun 19 04:27:34 devstack sudo[110820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:34 devstack sudo[110805]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af 1073741824" returned: 0 in 0.879s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:34 devstack sudo[110822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af Jun 19 04:27:34 devstack sudo[110822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:34 devstack sudo[110812]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" returned: 0 in 0.794s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:34 devstack sudo[110827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 Jun 19 04:27:34 devstack sudo[110827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:34 devstack sudo[110820]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22.13bf1603-95ec-4c29-90fe-1607c984d013" returned: 0 in 0.662s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-13bf1603-95ec-4c29-90fe-1607c984d013" released by "_delete_snapshot" :: held 3.139s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-c1e2b142-b137-49a0-ad9a-3f595e6fda22" released by "delete_snapshot" :: held 3.180s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Created reservations ['787022dc-2678-44fe-8466-05a94aa3c472', '9ece7033-34c5-44e0-8dfb-884c1119eab4', '5eedb48b-4efd-49e8-a794-fd4cb0f2d023', 'd814aaf9-2c5a-41dc-a295-0d762ed46415'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:35 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Delete snapshot completed successfully. Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c0f110fd-9480-44a0-a833-31de3c335d72 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-13bf1603-95ec-4c29-90fe-1607c984d013-delete_snapshot" released by "delete_snapshot" :: held 3.347s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:35 devstack sudo[110822]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af" returned: 0 in 0.785s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcff37d7-7306-49f7-9f56-eaf9f67fd2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d51a91-2384-4521-ae73-f3298dabde25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:35 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Volume volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af (6a1b5906-2314-4a0d-9546-ca7c11ad01af): created successfully Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4d51a91-2384-4521-ae73-f3298dabde25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Flow 'volume_create_manager' (1b9cb177-4df9-462b-939b-e60cdba9f021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:35 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e431029d-ffb7-45ce-9942-87006e83e979 tempest-VolumesListAdminTestJSON-783429574 None] Created volume successfully. Jun 19 04:27:35 devstack sudo[110827]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" returned: 0 in 0.738s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:35 devstack sudo[110835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66 Jun 19 04:27:35 devstack sudo[110835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Acquiring lock "cinder-6a1b5906-2314-4a0d-9546-ca7c11ad01af-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Lock "cinder-6a1b5906-2314-4a0d-9546-ca7c11ad01af-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=124,cinder:INSERT=41,cinder:UPDATE=149,cinder:DELETE=14 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Acquiring lock "cinder-quobyte-6a1b5906-2314-4a0d-9546-ca7c11ad01af" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Lock "cinder-quobyte-6a1b5906-2314-4a0d-9546-ca7c11ad01af" acquired by "delete_volume" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2279296f-4844-41a2-9895-440776af9baf]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "cinder-e9d83563-236b-4dfa-aabc-e4ec9cca15be-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-e9d83563-236b-4dfa-aabc-e4ec9cca15be-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "cinder-quobyte-e9d83563-236b-4dfa-aabc-e4ec9cca15be" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-quobyte-e9d83563-236b-4dfa-aabc-e4ec9cca15be" acquired by "delete_volume" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:35 devstack sudo[110837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af Jun 19 04:27:35 devstack sudo[110837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e3757aa-20b4-4a60-83f7-db1738e20829]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:35 devstack sudo[110839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be Jun 19 04:27:35 devstack sudo[110839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "cinder-c1e2b142-b137-49a0-ad9a-3f595e6fda22-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-c1e2b142-b137-49a0-ad9a-3f595e6fda22-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:36 devstack sudo[110835]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "cinder-quobyte-c1e2b142-b137-49a0-ad9a-3f595e6fda22" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5.fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" returned: 0 in 0.763s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-c1e2b142-b137-49a0-ad9a-3f595e6fda22" acquired by "delete_volume" :: waited 0.062s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-fcec6ab8-2ba5-401c-9e5a-c6dff2191a66" released by "_delete_snapshot" :: held 3.279s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" released by "delete_snapshot" :: held 3.305s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b138f3-1410-4773-ad98-2c1f14277a0e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Created reservations ['f6e7d48b-72b0-4cc3-9214-42b29687d0f1', '25314c2a-5b44-4c09-a489-29676798a35e', '6a52b106-6083-46fc-8a84-16546b99607e', 'df82c1c1-4c0c-45bd-a44c-b06d5560b1b7'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:36 devstack sudo[110842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 Jun 19 04:27:36 devstack sudo[110842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Delete snapshot completed successfully. Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b3f7dd4b-5fe2-44c6-8222-73da148aa21d tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-fcec6ab8-2ba5-401c-9e5a-c6dff2191a66-delete_snapshot" released by "delete_snapshot" :: held 3.503s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:36 devstack sudo[110837]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af" returned: 0 in 0.958s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:36 devstack sudo[110850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af Jun 19 04:27:36 devstack sudo[110850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:36 devstack sudo[110839]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be" returned: 0 in 0.863s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:36 devstack sudo[110852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be Jun 19 04:27:36 devstack sudo[110852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:37 devstack sudo[110842]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22" returned: 0 in 0.820s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:37 devstack sudo[110857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22 Jun 19 04:27:37 devstack sudo[110857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:37 devstack sudo[110850]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6a1b5906-2314-4a0d-9546-ca7c11ad01af" returned: 0 in 0.695s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Lock "cinder-quobyte-6a1b5906-2314-4a0d-9546-ca7c11ad01af" released by "delete_volume" :: held 1.707s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:37 devstack sudo[110852]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Created reservations ['6d2f32c6-dbd2-4d8f-aea0-4c1a89243a45', '6408ec8c-6159-48bd-b77a-1b88a8ef5910', '03e23042-233d-4dfa-98df-84a3af7df1ce', '1a9b1123-1756-4a85-9d83-a13556b397af'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e9d83563-236b-4dfa-aabc-e4ec9cca15be" returned: 0 in 0.774s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-quobyte-e9d83563-236b-4dfa-aabc-e4ec9cca15be" released by "delete_volume" :: held 1.690s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" acquired by "delete_volume" :: waited 0.041s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dca1eb17-0e59-4d39-a39b-dfed2c2caefc]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Created reservations ['95f85851-70a1-4fe6-b0c7-3eaccd5c9030', '82b1734a-6e67-4b42-9bc3-8ae6dd448b6f', '43f4d9c9-7993-4518-93a6-aa7bccee45ec', 'ae918b84-b16f-4dde-85bd-4e71f86a5478'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:37 devstack sudo[110861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 Jun 19 04:27:37 devstack sudo[110861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:37 devstack sudo[110862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:27:37 devstack sudo[110862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:37 devstack sudo[110866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:27:37 devstack sudo[110866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:37 devstack sudo[110857]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c1e2b142-b137-49a0-ad9a-3f595e6fda22" returned: 0 in 0.719s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-c1e2b142-b137-49a0-ad9a-3f595e6fda22" released by "delete_volume" :: held 1.637s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Created reservations ['5d8024cc-183a-47c8-918c-43c0c032d7c7', '9fe4f83f-e167-4937-91ba-379a4b0c76b8', '4418a7c7-48e6-4d85-ab33-bba15730481a', '8ac0b683-6724-467f-bd6c-3bc5d6bb8e89'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "cinder-b0fda611-5bba-4fc4-b3ed-ac280f09b664-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-b0fda611-5bba-4fc4-b3ed-ac280f09b664-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:38 devstack sudo[110868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:27:38 devstack sudo[110868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "cinder-quobyte-b0fda611-5bba-4fc4-b3ed-ac280f09b664" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-quobyte-b0fda611-5bba-4fc4-b3ed-ac280f09b664" acquired by "delete_volume" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dff0bce3-2010-487e-8316-c86fc7a18750]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "cinder-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:38 devstack sudo[110874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 Jun 19 04:27:38 devstack sudo[110874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:38 devstack sudo[110861]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" returned: 0 in 0.977s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:38 devstack sudo[110877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5 Jun 19 04:27:38 devstack sudo[110877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "cinder-quobyte-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" acquired by "delete_volume" :: waited 0.033s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae06b020-39f1-401a-8661-8691c108f43b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:38 devstack sudo[110862]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.075s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Deleted volume successfully. Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d1e07e64-60fd-4851-a33e-277274f28705 tempest-VolumesListAdminTestJSON-783429574 None] Lock "cinder-6a1b5906-2314-4a0d-9546-ca7c11ad01af-delete_volume" released by "delete_volume" :: held 3.175s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:38 devstack sudo[110880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc Jun 19 04:27:38 devstack sudo[110880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:38 devstack sudo[110866]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.108s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Deleted volume successfully. Jun 19 04:27:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ff458c36-dc68-4e44-a50d-593d834048fd tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-e9d83563-236b-4dfa-aabc-e4ec9cca15be-delete_volume" released by "delete_volume" :: held 3.171s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:39 devstack sudo[110868]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.009s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:39 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Deleted volume successfully. Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-776cbf08-49a5-4fc8-856e-4b892eb016c5 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-c1e2b142-b137-49a0-ad9a-3f595e6fda22-delete_volume" released by "delete_volume" :: held 3.068s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:39 devstack sudo[110874]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664" returned: 0 in 1.088s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:39 devstack sudo[110887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664 Jun 19 04:27:39 devstack sudo[110887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:39 devstack sudo[110877]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" returned: 0 in 0.912s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-quobyte-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5" released by "delete_volume" :: held 1.952s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Created reservations ['22ba822b-b7f6-42a2-b238-acc140015106', 'f5069e2b-455f-43f9-bd9d-69888bad2d08', '7e6e2d77-c03e-49bf-a192-c816e4cabcc6', 'c7f6efce-6043-427e-999a-d955a19cd6ee'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:39 devstack sudo[110880]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" returned: 0 in 0.888s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:39 devstack sudo[110892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc Jun 19 04:27:39 devstack sudo[110892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:39 devstack sudo[110894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:27:39 devstack sudo[110894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:40 devstack sudo[110887]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b0fda611-5bba-4fc4-b3ed-ac280f09b664" returned: 0 in 0.743s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-quobyte-b0fda611-5bba-4fc4-b3ed-ac280f09b664" released by "delete_volume" :: held 1.888s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Created reservations ['06236afc-e9be-46ce-9fca-0af83b428c5c', 'd9ced3eb-0b9c-453c-8a45-d44474bb5c6c', 'aaa320f1-40d6-4c99-83ca-960cc9882e51', '889addb0-2b2a-4e1c-893a-5dd3c2e0fec5'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:40 devstack sudo[110892]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" returned: 0 in 0.782s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-quobyte-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc" released by "delete_volume" :: held 1.729s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:40 devstack sudo[110899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:27:40 devstack sudo[110899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:40 devstack sudo[110894]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.783s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Deleted volume successfully. Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7512fcbb-51bb-4cc5-b9e4-8ac26fd822e1 tempest-VolumesSnapshotListTestJSON-85145183 None] Lock "cinder-b50d1286-adcd-4d23-ab4b-c3eb7e5a13f5-delete_volume" released by "delete_volume" :: held 3.054s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Created reservations ['42643928-f8f7-4c83-b243-d6acb100b5b0', '7e23830d-2bbc-42ad-932a-6f8ab8035ac2', 'a01a8980-4872-4964-afc9-11c285a7bda2', 'fda47d31-7f18-411d-bac1-8d9d07be4876'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "cinder-45b153bf-986d-4fab-b9fd-56b77231e088-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-45b153bf-986d-4fab-b9fd-56b77231e088-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:40 devstack sudo[110901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:27:40 devstack sudo[110901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "cinder-quobyte-45b153bf-986d-4fab-b9fd-56b77231e088" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-quobyte-45b153bf-986d-4fab-b9fd-56b77231e088" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[50201ef2-1cb1-4171-9756-be596b39cc86]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:40 devstack sudo[110903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088 Jun 19 04:27:40 devstack sudo[110903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:41 devstack sudo[110899]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.751s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Deleted volume successfully. Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6682090a-deb3-4b3b-aa20-f20a1540f74e tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-b0fda611-5bba-4fc4-b3ed-ac280f09b664-delete_volume" released by "delete_volume" :: held 2.964s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:41 devstack sudo[110901]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.013s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Deleted volume successfully. Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99c86ce-24de-46ab-8d6d-01fa34c06672 tempest-VolumeDependencyTests-1922823037 None] Lock "cinder-12b0d2c7-b2ba-4bcb-b33f-2d2585b124fc-delete_volume" released by "delete_volume" :: held 3.094s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:41 devstack sudo[110903]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088" returned: 0 in 1.086s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:41 devstack sudo[110914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088 Jun 19 04:27:41 devstack sudo[110914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:41 devstack sudo[110916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:27:41 devstack sudo[110916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:42 devstack sudo[110914]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45b153bf-986d-4fab-b9fd-56b77231e088" returned: 0 in 0.737s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-quobyte-45b153bf-986d-4fab-b9fd-56b77231e088" released by "delete_volume" :: held 1.889s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Created reservations ['b014e5c6-839f-4c2a-b3aa-6c66d8ff0ae7', 'f1f690c3-60c9-4966-b917-29ce239408ab', '54ffd2d6-03d9-4c16-9121-fdccdebc9811', 'b8e11af0-d2da-47fb-ab9c-77a58872bb95'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:42 devstack sudo[110920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:27:42 devstack sudo[110920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:42 devstack sudo[110916]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.920s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:27:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:27:43 devstack sudo[110920]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.694s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:43 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:27:43 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Deleted volume successfully. Jun 19 04:27:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82de7d0e-bcaa-4ebb-baf6-8453e9112ca9 tempest-VolumesListAdminTestJSON-543760841 None] Lock "cinder-45b153bf-986d-4fab-b9fd-56b77231e088-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Flow 'volume_create_manager' (28f33ccf-c4df-4271-9b44-5db59d08c909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f50d2e-d073-49c6-adeb-6376bc40d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84f50d2e-d073-49c6-adeb-6376bc40d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d81dad6-1d81-43a0-8b83-3cf1b29450cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf86667739c49c8850f8de3c0970c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:45Z,use_quota=True,user_id='3bb4539c6dcf44cea417a38ea0b58d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430e04c6-b4dc-412f-af05-74ab02ea3b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (430e04c6-b4dc-412f-af05-74ab02ea3b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4770d26-5086-4696-8898-27acf864c129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4770d26-5086-4696-8898-27acf864c129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d81dad6-1d81-43a0-8b83-3cf1b29450cf', 'volume_name': 'volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5852e4d8-19cc-4aea-8ad8-5b40c371edd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5852e4d8-19cc-4aea-8ad8-5b40c371edd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a500638-7d8e-4ed1-9486-5df2b3d63fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:45 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Volume 8d81dad6-1d81-43a0-8b83-3cf1b29450cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf', 'volume_size': 1} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:45Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d81dad6-1d81-43a0-8b83-3cf1b29450cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf86667739c49c8850f8de3c0970c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:45Z,use_quota=True,user_id='3bb4539c6dcf44cea417a38ea0b58d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Creating volume 8d81dad6-1d81-43a0-8b83-3cf1b29450cf {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:45 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:27:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:45 devstack sudo[110925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf 1073741824 Jun 19 04:27:45 devstack sudo[110925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:46 devstack sudo[110925]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf 1073741824" returned: 0 in 0.934s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:46 devstack sudo[110931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf Jun 19 04:27:46 devstack sudo[110931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:47 devstack sudo[110931]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf" returned: 0 in 0.700s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] <== create_volume: return (1685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.688s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a500638-7d8e-4ed1-9486-5df2b3d63fe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72985c3-6bb3-467b-8e4b-fb772d2d5d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:47 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Volume volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf (8d81dad6-1d81-43a0-8b83-3cf1b29450cf): created successfully Jun 19 04:27:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d72985c3-6bb3-467b-8e4b-fb772d2d5d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Flow 'volume_create_manager' (28f33ccf-c4df-4271-9b44-5db59d08c909) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6b890b88-b584-468d-8fe5-03e5a5552124 tempest-CinderUnicodeTest-1733275690 None] Created volume successfully. Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Flow 'volume_create_manager' (0e5ab019-2dd6-4796-9aa7-3f8675d8d27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd0be99-6628-44a6-9ad0-1ec9f715e6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcd0be99-6628-44a6-9ad0-1ec9f715e6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1922206941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9f375b-6bb4-4224-83dc-35644845996a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf86667739c49c8850f8de3c0970c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:48Z,use_quota=True,user_id='3bb4539c6dcf44cea417a38ea0b58d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e4d21b-25bd-462e-a311-b5841742e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9e4d21b-25bd-462e-a311-b5841742e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba5fca4-f7ee-4608-bec5-ca304fc32343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eba5fca4-f7ee-4608-bec5-ca304fc32343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd9f375b-6bb4-4224-83dc-35644845996a', 'volume_name': 'volume-bd9f375b-6bb4-4224-83dc-35644845996a', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690dae84-45d6-4b0d-bbe0-94c1d80c575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690dae84-45d6-4b0d-bbe0-94c1d80c575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e5a1e4-56d7-406e-a4b8-16d27c22b11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:48 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Volume bd9f375b-6bb4-4224-83dc-35644845996a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd9f375b-6bb4-4224-83dc-35644845996a', 'volume_size': 1} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:48Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1922206941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd9f375b-6bb4-4224-83dc-35644845996a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1bf86667739c49c8850f8de3c0970c4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:48Z,use_quota=True,user_id='3bb4539c6dcf44cea417a38ea0b58d44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Creating volume bd9f375b-6bb4-4224-83dc-35644845996a {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:48 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:27:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:48 devstack sudo[110934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a 1073741824 Jun 19 04:27:48 devstack sudo[110934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:49 devstack sudo[110934]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a 1073741824" returned: 0 in 1.193s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:49 devstack sudo[110940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a Jun 19 04:27:49 devstack sudo[110940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:50 devstack sudo[110940]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a" returned: 0 in 0.865s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] <== create_volume: return (2110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.115s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e5a1e4-56d7-406e-a4b8-16d27c22b11e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd9f375b-6bb4-4224-83dc-35644845996a', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec305c1-8c11-473e-b332-b1f5df516748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:50 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Volume volume-bd9f375b-6bb4-4224-83dc-35644845996a (bd9f375b-6bb4-4224-83dc-35644845996a): created successfully Jun 19 04:27:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ec305c1-8c11-473e-b332-b1f5df516748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:50 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Flow 'volume_create_manager' (0e5ab019-2dd6-4796-9aa7-3f8675d8d27f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:50 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-29aa97ea-410d-4264-ba53-950972c5ba4d tempest-CinderUnicodeTest-1733275690 None] Created volume successfully. Jun 19 04:27:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Creating offline snapshot de194571-ac93-4657-830d-8c31165f7f60 of volume bd9f375b-6bb4-4224-83dc-35644845996a {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:27:51 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[918cab93-7a77-449e-8153-6b0248464b29]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:51 devstack sudo[110944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a Jun 19 04:27:51 devstack sudo[110944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Flow 'volume_create_manager' (f1e654e8-6537-41bd-a523-b9a894d9b9c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ede5823-6dc2-41cc-adc2-3b3bf2d581c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack sudo[110944]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a" returned: 0 in 1.043s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ede5823-6dc2-41cc-adc2-3b3bf2d581c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1963322709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2635889b-5fa3-4044-9471-ebfbbf2449ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c23bc132624be697cb8f4003e42ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:53Z,use_quota=True,user_id='821621818fa24e4f9c8cb37169253875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c557bd78-341e-4753-97d0-693ec4bc0747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack sudo[110949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 1G Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c557bd78-341e-4753-97d0-693ec4bc0747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack sudo[110949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800ef558-7ee0-4000-9948-ced20de4abfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (800ef558-7ee0-4000-9948-ced20de4abfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2635889b-5fa3-4044-9471-ebfbbf2449ef', 'volume_name': 'volume-2635889b-5fa3-4044-9471-ebfbbf2449ef', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21dbd1a-9b60-4e0e-b6cc-668b8fb2edab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b21dbd1a-9b60-4e0e-b6cc-668b8fb2edab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ba66a1-5779-4ad4-87b7-57d54a5e47ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:52 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Volume 2635889b-5fa3-4044-9471-ebfbbf2449ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2635889b-5fa3-4044-9471-ebfbbf2449ef', 'volume_size': 1} Jun 19 04:27:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:53 devstack sudo[110949]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 1G" returned: 0 in 0.985s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f375b-6bb4-4224-83dc-35644845996a -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:53 devstack sudo[110955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f375b-6bb4-4224-83dc-35644845996a -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 Jun 19 04:27:53 devstack sudo[110955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:54 devstack sudo[110955]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bd9f375b-6bb4-4224-83dc-35644845996a -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60" returned: 0 in 0.735s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:54 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 is being set with open permissions: ugo+rw Jun 19 04:27:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:54 devstack sudo[110960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 Jun 19 04:27:54 devstack sudo[110960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:55 devstack sudo[110960]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60" returned: 0 in 0.767s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:55 devstack sudo[110969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.info Jun 19 04:27:55 devstack sudo[110969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:55 devstack sudo[110969]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.info" returned: 0 in 0.722s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:55 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.info is being set with open permissions: ugo+rw Jun 19 04:27:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:55 devstack sudo[110972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.info Jun 19 04:27:55 devstack sudo[110972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:56 devstack sudo[110972]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.info" returned: 0 in 0.748s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.102s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.935s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:27:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1963322709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2635889b-5fa3-4044-9471-ebfbbf2449ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='13c23bc132624be697cb8f4003e42ec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:27:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:27:53Z,use_quota=True,user_id='821621818fa24e4f9c8cb37169253875',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Creating volume 2635889b-5fa3-4044-9471-ebfbbf2449ef {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:27:56 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:27:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:56 devstack sudo[110975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef 1073741824 Jun 19 04:27:56 devstack sudo[110975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-23260f63-daaa-4b85-81ad-55535fa39dd1 tempest-CinderUnicodeTest-1733275690 None] Create snapshot completed successfully Jun 19 04:27:57 devstack sudo[110975]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef 1073741824" returned: 0 in 0.907s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:57 devstack sudo[110981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef Jun 19 04:27:57 devstack sudo[110981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "cinder-de194571-ac93-4657-830d-8c31165f7f60-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-de194571-ac93-4657-830d-8c31165f7f60-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "cinder-quobyte-bd9f375b-6bb4-4224-83dc-35644845996a" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-quobyte-bd9f375b-6bb4-4224-83dc-35644845996a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "cinder-quobyte-de194571-ac93-4657-830d-8c31165f7f60" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:57 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-quobyte-de194571-ac93-4657-830d-8c31165f7f60" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Deleting offline snapshot de194571-ac93-4657-830d-8c31165f7f60 of volume bd9f375b-6bb4-4224-83dc-35644845996a {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] snapshot_file for this snap is: volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f022e6c-51e4-4724-9a6a-ed2833d100d6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:58 devstack sudo[110983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 Jun 19 04:27:58 devstack sudo[110983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:58 devstack sudo[110981]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef" returned: 0 in 0.686s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.645s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1ba66a1-5779-4ad4-87b7-57d54a5e47ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2635889b-5fa3-4044-9471-ebfbbf2449ef', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc548e5b-7b3e-4edd-b373-66e684514db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:27:58 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Volume volume-2635889b-5fa3-4044-9471-ebfbbf2449ef (2635889b-5fa3-4044-9471-ebfbbf2449ef): created successfully Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc548e5b-7b3e-4edd-b373-66e684514db1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:27:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Flow 'volume_create_manager' (f1e654e8-6537-41bd-a523-b9a894d9b9c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:27:58 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3541c619-2067-46fb-bdb3-8f00ce792378 tempest-AbsoluteLimitsTests-1742359556 None] Created volume successfully. Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Acquiring lock "cinder-2635889b-5fa3-4044-9471-ebfbbf2449ef-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:59 devstack sudo[110983]: pam_unix(sudo:session): session closed for user root Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60" returned: 0 in 1.090s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bd9f375b-6bb4-4224-83dc-35644845996a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Lock "cinder-2635889b-5fa3-4044-9471-ebfbbf2449ef-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f36672d-74cb-46dc-950e-68ee981f56a7]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Acquiring lock "cinder-quobyte-2635889b-5fa3-4044-9471-ebfbbf2449ef" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Lock "cinder-quobyte-2635889b-5fa3-4044-9471-ebfbbf2449ef" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d06c3f-6f6d-4a1a-afbf-4bc1f7927a0a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:27:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:27:59 devstack sudo[110990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a Jun 19 04:27:59 devstack sudo[110990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:27:59 devstack sudo[110991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef Jun 19 04:27:59 devstack sudo[110991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:00 devstack sudo[110990]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a" returned: 0 in 0.813s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:00 devstack sudo[111001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 Jun 19 04:28:00 devstack sudo[111001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:00 devstack sudo[110991]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef" returned: 0 in 0.812s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:00 devstack sudo[111003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef Jun 19 04:28:00 devstack sudo[111003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:00 devstack sudo[111003]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2635889b-5fa3-4044-9471-ebfbbf2449ef" returned: 0 in 0.682s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Lock "cinder-quobyte-2635889b-5fa3-4044-9471-ebfbbf2449ef" released by "delete_volume" :: held 1.557s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:00 devstack sudo[111001]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60" returned: 0 in 0.861s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Created reservations ['55dea1f1-29a2-4e80-a908-e9a7976b605c', 'a48dcb3e-9994-4832-be42-e6173033e94d', 'cc301318-d70e-4390-a116-872a3e20c4e9', 'e83ff16a-c194-43a4-8c35-6b0c9ce13e13'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:00 devstack sudo[111009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60 Jun 19 04:28:00 devstack sudo[111009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:00 devstack sudo[111011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:28:00 devstack sudo[111011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:01 devstack sudo[111011]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.803s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:01 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:01 devstack sudo[111009]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:01 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Deleted volume successfully. Jun 19 04:28:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a.de194571-ac93-4657-830d-8c31165f7f60" returned: 0 in 0.919s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6d172a8f-75d7-4576-96ef-388b66f5bc10 tempest-AbsoluteLimitsTests-1742359556 None] Lock "cinder-2635889b-5fa3-4044-9471-ebfbbf2449ef-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-quobyte-de194571-ac93-4657-830d-8c31165f7f60" released by "_delete_snapshot" :: held 3.852s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-quobyte-bd9f375b-6bb4-4224-83dc-35644845996a" released by "delete_snapshot" :: held 3.878s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:01 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Created reservations ['f64db49f-1cdf-4bf7-9594-634a779cbe55', '4e392770-c773-4d19-9023-171945747647', 'ba7d9649-8500-494d-8cb0-3da73612a0c0', 'cd357b2a-1281-42a6-bfc3-89be2524b173'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Delete snapshot completed successfully. Jun 19 04:28:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-518e2ce1-18e5-4608-9be1-f48c4d7a3f96 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-de194571-ac93-4657-830d-8c31165f7f60-delete_snapshot" released by "delete_snapshot" :: held 4.064s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "cinder-bd9f375b-6bb4-4224-83dc-35644845996a-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-bd9f375b-6bb4-4224-83dc-35644845996a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "cinder-quobyte-bd9f375b-6bb4-4224-83dc-35644845996a" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-quobyte-bd9f375b-6bb4-4224-83dc-35644845996a" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:02 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3658070-03ef-45a2-93a9-ad4f79c576be]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:02 devstack sudo[111016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a Jun 19 04:28:02 devstack sudo[111016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:03 devstack sudo[111016]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a" returned: 0 in 0.835s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:03 devstack sudo[111021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a Jun 19 04:28:03 devstack sudo[111021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:03 devstack sudo[111021]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bd9f375b-6bb4-4224-83dc-35644845996a" returned: 0 in 0.786s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-quobyte-bd9f375b-6bb4-4224-83dc-35644845996a" released by "delete_volume" :: held 1.703s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Created reservations ['2a02d6d5-76ee-462b-84ce-8a144f5c60e6', '527874c5-778c-4de1-b340-5e98fe5a5228', '2c6f00d5-06a9-41e5-b405-de4b53efab41', '8498230a-0d75-463e-9500-0b7fc31d273c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:04 devstack sudo[111024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:28:04 devstack sudo[111024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "cinder-8d81dad6-1d81-43a0-8b83-3cf1b29450cf-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-8d81dad6-1d81-43a0-8b83-3cf1b29450cf-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "cinder-quobyte-8d81dad6-1d81-43a0-8b83-3cf1b29450cf" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-quobyte-8d81dad6-1d81-43a0-8b83-3cf1b29450cf" acquired by "delete_volume" :: waited 0.028s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfbae86-567a-4ef7-abe9-e7cd275b6999]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:04 devstack sudo[111026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf Jun 19 04:28:04 devstack sudo[111026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.001s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:05 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:05 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Deleted volume successfully. Jun 19 04:28:05 devstack sudo[111024]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:05 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-40a31233-226d-4515-8174-d6e28b4d397c tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-bd9f375b-6bb4-4224-83dc-35644845996a-delete_volume" released by "delete_volume" :: held 3.060s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:05 devstack sudo[111026]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf" returned: 0 in 1.067s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:05 devstack sudo[111032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf Jun 19 04:28:05 devstack sudo[111032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:06 devstack sudo[111032]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-8d81dad6-1d81-43a0-8b83-3cf1b29450cf" returned: 0 in 0.737s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-quobyte-8d81dad6-1d81-43a0-8b83-3cf1b29450cf" released by "delete_volume" :: held 1.861s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Flow 'volume_create_manager' (d2f054c9-44f0-4d02-8d62-febf2dd6ea10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77749444-a327-4621-8476-7b2a0efa6b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77749444-a327-4621-8476-7b2a0efa6b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-203856930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a43238c8191496c9fa70a98c39b8418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:07Z,use_quota=True,user_id='946886be6fe34eef9cd96f0f485b78e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6c6eb3-9db2-4c9c-993c-2aa1b1a46ea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a6c6eb3-9db2-4c9c-993c-2aa1b1a46ea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a418374-a67a-41d8-a929-f4d48815690e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a418374-a67a-41d8-a929-f4d48815690e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf', 'volume_name': 'volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748b6022-87f5-402e-81ac-dabd5e6fed71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (748b6022-87f5-402e-81ac-dabd5e6fed71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2709db4b-56de-4644-9e67-1191027d5a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:06 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Volume 0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf', 'volume_size': 1} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-203856930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a43238c8191496c9fa70a98c39b8418',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:07Z,use_quota=True,user_id='946886be6fe34eef9cd96f0f485b78e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Creating volume 0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:06 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Created reservations ['4f55207e-aa3a-42d2-8671-5a2a7c47ecdb', 'fde6cc1f-c589-4c52-85d2-66f4bebd5ee2', '1e960086-b841-4c0d-9b77-f2dc43ee6c39', 'eabcdde3-61bb-47aa-b525-61055f13e96a'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:06 devstack sudo[111035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf 1073741824 Jun 19 04:28:06 devstack sudo[111035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:06 devstack sudo[111037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:28:06 devstack sudo[111037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:07 devstack sudo[111037]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.700s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:07 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:07 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Deleted volume successfully. Jun 19 04:28:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e1d73f5d-2dcf-4766-8290-5fc326169a55 tempest-CinderUnicodeTest-1733275690 None] Lock "cinder-8d81dad6-1d81-43a0-8b83-3cf1b29450cf-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:07 devstack sudo[111035]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf 1073741824" returned: 0 in 0.991s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:07 devstack sudo[111044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf Jun 19 04:28:07 devstack sudo[111044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:08 devstack sudo[111044]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf" returned: 0 in 0.669s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.712s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2709db4b-56de-4644-9e67-1191027d5a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8784deb1-c4f8-4035-8642-16c15657a536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:08 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Volume volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf (0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf): created successfully Jun 19 04:28:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8784deb1-c4f8-4035-8642-16c15657a536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Flow 'volume_create_manager' (d2f054c9-44f0-4d02-8d62-febf2dd6ea10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:08 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-fddf9d14-e7a8-4b38-a015-e4fb65c9f73a tempest-VolumesMetadataTest-2142880253 None] Created volume successfully. Jun 19 04:28:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Acquiring lock "cinder-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Lock "cinder-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Acquiring lock "cinder-quobyte-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Lock "cinder-quobyte-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf" acquired by "delete_volume" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:09 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[da8cdc39-8e4c-4dae-88ae-6da70f3922ab]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:09 devstack sudo[111047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf Jun 19 04:28:09 devstack sudo[111047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Flow 'volume_create_manager' (b365c816-2457-4505-84f9-2ad1ac136539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb07c76-a407-4cf0-8f48-3b4ade632367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb07c76-a407-4cf0-8f48-3b4ade632367) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-417096573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce48cef-0cb7-4b86-9ce7-8425a7a478c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696972796ded49e6ae48379998fbbbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:10Z,use_quota=True,user_id='caaeb499db6649b09ca07334b4b8ee76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9530bfad-5110-499f-9395-f7d4d914d4b2),volume_type_id=9530bfad-5110-499f-9395-f7d4d914d4b2)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cdbed2-f0f2-4e9b-8171-13bf57aceb83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cdbed2-f0f2-4e9b-8171-13bf57aceb83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938250d7-82c9-4eda-b26f-c723b2126feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938250d7-82c9-4eda-b26f-c723b2126feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ce48cef-0cb7-4b86-9ce7-8425a7a478c8', 'volume_name': 'volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab5a1a9-a4c7-4a28-8104-9e255b6ffac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cab5a1a9-a4c7-4a28-8104-9e255b6ffac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb412009-c547-402a-96c9-9c9091e1babf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Volume 0ce48cef-0cb7-4b86-9ce7-8425a7a478c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8', 'volume_size': 1} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-417096573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ce48cef-0cb7-4b86-9ce7-8425a7a478c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696972796ded49e6ae48379998fbbbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:10Z,use_quota=True,user_id='caaeb499db6649b09ca07334b4b8ee76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9530bfad-5110-499f-9395-f7d4d914d4b2),volume_type_id=9530bfad-5110-499f-9395-f7d4d914d4b2)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Creating volume 0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:10 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:10 devstack sudo[111049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 1073741824 Jun 19 04:28:10 devstack sudo[111049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Flow 'volume_create_manager' (86c3defc-57ef-41d9-96e3-537c88fefd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92dfbbee-4654-4850-9bf8-7c934a24b7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92dfbbee-4654-4850-9bf8-7c934a24b7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1246696622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff71c314-c43f-4f64-b0f3-37af4ae15204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696972796ded49e6ae48379998fbbbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:11Z,use_quota=True,user_id='caaeb499db6649b09ca07334b4b8ee76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9d78830-244d-431c-9da4-bb00f96c8b23),volume_type_id=e9d78830-244d-431c-9da4-bb00f96c8b23)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107eeb86-2ee6-4c33-a659-ff74d05a43cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack sudo[111047]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (107eeb86-2ee6-4c33-a659-ff74d05a43cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c1c9b9-caf2-47c4-900b-049a46cdba25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6c1c9b9-caf2-47c4-900b-049a46cdba25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff71c314-c43f-4f64-b0f3-37af4ae15204', 'volume_name': 'volume-ff71c314-c43f-4f64-b0f3-37af4ae15204', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ecfbb2-a81a-47c5-a060-f74c93fb7df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5ecfbb2-a81a-47c5-a060-f74c93fb7df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37e21cd-2388-491a-aef4-6928ec86f544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:10 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Volume ff71c314-c43f-4f64-b0f3-37af4ae15204: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff71c314-c43f-4f64-b0f3-37af4ae15204', 'volume_size': 1} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf" returned: 0 in 1.004s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:10 devstack sudo[111055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf Jun 19 04:28:10 devstack sudo[111055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:11 devstack sudo[111049]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 1073741824" returned: 0 in 1.103s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:11 devstack sudo[111062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 Jun 19 04:28:11 devstack sudo[111062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Flow 'volume_create_manager' (83a042c4-2661-45bf-8535-6ed05359989f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c3fc25-4b86-4825-b52b-c9c856675d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c3fc25-4b86-4825-b52b-c9c856675d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-386411177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696972796ded49e6ae48379998fbbbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:11Z,use_quota=True,user_id='caaeb499db6649b09ca07334b4b8ee76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e66ad4bd-7bd2-4257-a062-83cd9de7aa86),volume_type_id=e66ad4bd-7bd2-4257-a062-83cd9de7aa86)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d75165a-cfbd-4223-92a1-07e8c63615a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d75165a-cfbd-4223-92a1-07e8c63615a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b456fb-7dd0-407e-8c3b-bc02cd4c4dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.image.glance [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Creating Keystone auth plugin from conf {{(pid=93769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:28:11 devstack sudo[111055]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf" returned: 0 in 0.812s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Lock "cinder-quobyte-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf" released by "delete_volume" :: held 1.868s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Created reservations ['e578be8b-dbb6-4c7a-ad6e-1de0e291a69a', 'c2ee65b9-bc6d-465d-ad53-e5239d2372df', 'e123647b-53e9-45fa-977f-9e2961cf60fd', '69760d5e-83f9-4278-bbe8-9af2bdaf0cdc'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:11 devstack sudo[111065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:28:11 devstack sudo[111065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b456fb-7dd0-407e-8c3b-bc02cd4c4dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a', 'volume_name': 'volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a', 'volume_size': 1, 'image_id': '48f144f9-8f65-4076-815d-182823d98531', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48f144f9-8f65-4076-815d-182823d98531', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1235277930', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '696972796ded49e6ae48379998fbbbe6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '48f144f9-8f65-4076-815d-182823d98531', 'created_at': datetime.datetime(2026, 6, 19, 2, 28, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 28, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48f144f9-8f65-4076-815d-182823d98531/file', 'properties': {}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0a5902-6b27-4141-9667-369b9340aa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc0a5902-6b27-4141-9667-369b9340aa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7185f9f1-8a0e-4150-afc3-995ff4474a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:11 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Volume f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a', 'volume_size': 1, 'image_id': '48f144f9-8f65-4076-815d-182823d98531', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48f144f9-8f65-4076-815d-182823d98531', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1235277930', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '696972796ded49e6ae48379998fbbbe6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '48f144f9-8f65-4076-815d-182823d98531', 'created_at': datetime.datetime(2026, 6, 19, 2, 28, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 28, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48f144f9-8f65-4076-815d-182823d98531/file', 'properties': {}}, 'image_service': } Jun 19 04:28:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Trying to clone f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a from image 48f144f9-8f65-4076-815d-182823d98531 at location (None, [{'url': 'file:///opt/stack/data/glance/images/48f144f9-8f65-4076-815d-182823d98531', 'metadata': {}}]). {{(pid=93769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:28:12 devstack sudo[111062]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8" returned: 0 in 0.758s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] <== create_volume: return (1921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.924s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.360s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1246696622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff71c314-c43f-4f64-b0f3-37af4ae15204,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696972796ded49e6ae48379998fbbbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:11Z,use_quota=True,user_id='caaeb499db6649b09ca07334b4b8ee76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e9d78830-244d-431c-9da4-bb00f96c8b23),volume_type_id=e9d78830-244d-431c-9da4-bb00f96c8b23)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Creating volume ff71c314-c43f-4f64-b0f3-37af4ae15204 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:12 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb412009-c547-402a-96c9-9c9091e1babf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:12 devstack sudo[111068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 1073741824 Jun 19 04:28:12 devstack sudo[111068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff7dcc3-d052-40a2-b1e6-2bb458009d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:12 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Volume volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 (0ce48cef-0cb7-4b86-9ce7-8425a7a478c8): created successfully Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ff7dcc3-d052-40a2-b1e6-2bb458009d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Flow 'volume_create_manager' (b365c816-2457-4505-84f9-2ad1ac136539) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:12 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5f6caeb2-8217-4c3f-9f3d-4d6698cb86a0 tempest-TestInstancesWithCinderVolumes-1767651281 None] Created volume successfully. Jun 19 04:28:12 devstack sudo[111065]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.853s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:12 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Deleted volume successfully. Jun 19 04:28:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-871bdd82-fc84-466c-9b44-758b33a7ecc1 tempest-VolumesMetadataTest-2142880253 None] Lock "cinder-0418f1cb-d16c-439c-9ed4-8cd70c6d2dcf-delete_volume" released by "delete_volume" :: held 2.992s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:13 devstack sudo[111068]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 1073741824" returned: 0 in 1.063s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:13 devstack sudo[111110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 Jun 19 04:28:13 devstack sudo[111110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:14 devstack sudo[111110]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204" returned: 0 in 0.852s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.978s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f37e21cd-2388-491a-aef4-6928ec86f544) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff71c314-c43f-4f64-b0f3-37af4ae15204', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14762884-286a-4c15-9329-fdf2deb5d2d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:14 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Volume volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 (ff71c314-c43f-4f64-b0f3-37af4ae15204): created successfully Jun 19 04:28:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14762884-286a-4c15-9329-fdf2deb5d2d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Flow 'volume_create_manager' (86c3defc-57ef-41d9-96e3-537c88fefd7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:14 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=98,cinder:UPDATE=141,cinder:INSERT=32,cinder:DELETE=16 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:28:14 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5b8fad61-b1bb-43b8-8ac1-7cc23fce41cc tempest-TestInstancesWithCinderVolumes-1767651281 None] Created volume successfully. Jun 19 04:28:15 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD, size 20.69 MB, duration 3.82 sec {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:28:15 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Image download 20.69 MB at 5.41 MB/s Jun 19 04:28:15 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e598b78-c93b-4324-aae2-375e1eb29efe]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:15 devstack sudo[111115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD Jun 19 04:28:15 devstack sudo[111115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:16 devstack sudo[111115]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD" returned: 0 in 0.764s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Temporary image 48f144f9-8f65-4076-815d-182823d98531 is fetched for user caaeb499db6649b09ca07334b4b8ee76. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef38a1a9-c0bb-48ca-800a-15a0f030b9a1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:16 devstack sudo[111120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD Jun 19 04:28:16 devstack sudo[111120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Flow 'volume_create_manager' (d6ca885e-c8c3-4117-a8f1-dc975320cd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2916531d-fcff-4c31-8129-65dcf0ba8957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2916531d-fcff-4c31-8129-65dcf0ba8957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-560691409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e875190b-4012-4e07-886a-181f703dd0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3275d47b34485dad92c1bf51834b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:17Z,use_quota=True,user_id='988dce951e60443e98c8b52a26c3333e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dd0f37-df13-48fa-a8eb-cddc39953e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48dd0f37-df13-48fa-a8eb-cddc39953e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b9d2c8-9306-4032-9698-9ea800cf963d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55b9d2c8-9306-4032-9698-9ea800cf963d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e875190b-4012-4e07-886a-181f703dd0aa', 'volume_name': 'volume-e875190b-4012-4e07-886a-181f703dd0aa', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9db0e2-2778-413e-a39f-0c87324dc057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b9db0e2-2778-413e-a39f-0c87324dc057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a667f46a-c2aa-422a-8ff3-9fbb29ef44de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:16 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Volume e875190b-4012-4e07-886a-181f703dd0aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e875190b-4012-4e07-886a-181f703dd0aa', 'volume_size': 1} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-560691409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e875190b-4012-4e07-886a-181f703dd0aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3275d47b34485dad92c1bf51834b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:17Z,use_quota=True,user_id='988dce951e60443e98c8b52a26c3333e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Creating volume e875190b-4012-4e07-886a-181f703dd0aa {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:16 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:28:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:17 devstack sudo[111122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa 1073741824 Jun 19 04:28:17 devstack sudo[111122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:17 devstack sudo[111120]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:17 devstack sudo[111122]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa 1073741824" returned: 0 in 0.807s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:17 devstack sudo[111131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa Jun 19 04:28:17 devstack sudo[111131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:18 devstack sudo[111131]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa" returned: 0 in 0.615s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.966s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-386411177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='696972796ded49e6ae48379998fbbbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:11Z,use_quota=True,user_id='caaeb499db6649b09ca07334b4b8ee76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e66ad4bd-7bd2-4257-a062-83cd9de7aa86),volume_type_id=e66ad4bd-7bd2-4257-a062-83cd9de7aa86)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Creating volume f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:18 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a667f46a-c2aa-422a-8ff3-9fbb29ef44de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e875190b-4012-4e07-886a-181f703dd0aa', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:18 devstack sudo[111134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a 1073741824 Jun 19 04:28:18 devstack sudo[111134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52879563-201a-436a-89eb-6d57b6dfaee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:18 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Volume volume-e875190b-4012-4e07-886a-181f703dd0aa (e875190b-4012-4e07-886a-181f703dd0aa): created successfully Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52879563-201a-436a-89eb-6d57b6dfaee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Flow 'volume_create_manager' (d6ca885e-c8c3-4117-a8f1-dc975320cd63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:18 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ec8c8406-f784-4f46-bacf-806dcf9177e1 tempest-VolumesTransfersTest-925226942 None] Created volume successfully. Jun 19 04:28:19 devstack sudo[111134]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a 1073741824" returned: 0 in 0.867s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:19 devstack sudo[111139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a Jun 19 04:28:19 devstack sudo[111139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:19 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9a4fd615-f5fd-4941-a80e-51439aa2b648 tempest-VolumesTransfersTest-1632039382 None] Transfer volume completed successfully. Jun 19 04:28:20 devstack sudo[111139]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" returned: 0 in 0.666s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] <== create_volume: return (1573ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.576s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Attempting download of 48f144f9-8f65-4076-815d-182823d98531 ((None, [{'url': 'file:///opt/stack/data/glance/images/48f144f9-8f65-4076-815d-182823d98531', 'metadata': {}}])) to volume f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c7e1a5-b6a7-4714-b7b3-8fb5782e2105]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48f144f9-8f65-4076-815d-182823d98531_ohgss1ub {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:20 devstack sudo[111142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48f144f9-8f65-4076-815d-182823d98531_ohgss1ub Jun 19 04:28:20 devstack sudo[111142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Acquiring lock "cinder-e875190b-4012-4e07-886a-181f703dd0aa-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Lock "cinder-e875190b-4012-4e07-886a-181f703dd0aa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Acquiring lock "cinder-quobyte-e875190b-4012-4e07-886a-181f703dd0aa" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Lock "cinder-quobyte-e875190b-4012-4e07-886a-181f703dd0aa" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ed9384b-981c-429e-9653-13d34bbdb971]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:20 devstack sudo[111144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa Jun 19 04:28:20 devstack sudo[111144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:20 devstack sudo[111142]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_48f144f9-8f65-4076-815d-182823d98531_ohgss1ub" returned: 0 in 0.793s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48f144f9-8f65-4076-815d-182823d98531_ohgss1ub {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:20 devstack sudo[111148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48f144f9-8f65-4076-815d-182823d98531_ohgss1ub Jun 19 04:28:20 devstack sudo[111148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:21 devstack sudo[111144]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa" returned: 0 in 0.757s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:21 devstack sudo[111154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa Jun 19 04:28:21 devstack sudo[111154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:21 devstack sudo[111148]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48f144f9-8f65-4076-815d-182823d98531_ohgss1ub" returned: 1 in 0.728s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_48f144f9-8f65-4076-815d-182823d98531_ohgss1ub' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:28:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[63012a1b-da01-45ad-9377-77ba9efbdf7c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:21 devstack sudo[111158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD Jun 19 04:28:21 devstack sudo[111158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:22 devstack sudo[111154]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e875190b-4012-4e07-886a-181f703dd0aa" returned: 0 in 0.659s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Lock "cinder-quobyte-e875190b-4012-4e07-886a-181f703dd0aa" released by "delete_volume" :: held 1.461s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Created reservations ['0584a625-901a-476e-b8a5-a93efa63b56c', 'd4cfd2b0-9962-4231-a257-65f9df747eb4', '391cc2e7-1ae0-4748-aed3-b33c7e4aadf5', '2bbb488c-5af8-4ec3-a823-6befef155c36'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:22 devstack sudo[111161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:28:22 devstack sudo[111161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:22 devstack sudo[111158]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD" returned: 0 in 0.715s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] 48f144f9-8f65-4076-815d-182823d98531 was qcow2, converting to raw {{(pid=93769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:22 devstack sudo[111166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a Jun 19 04:28:22 devstack sudo[111166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:22 devstack sudo[111161]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.655s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Deleted volume successfully. Jun 19 04:28:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-7280fc5f-42de-4c17-afaf-61652fed780b tempest-VolumesTransfersTest-892619019 None] Lock "cinder-e875190b-4012-4e07-886a-181f703dd0aa-delete_volume" released by "delete_volume" :: held 2.316s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Flow 'volume_create_manager' (30e9301e-63ef-4f76-bb82-eb67a68b630f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4958f988-68ba-4432-b873-e648b86cb749) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4958f988-68ba-4432-b873-e648b86cb749) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-794516733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5611495-447b-4844-8e0c-bdbb7ae1726c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3275d47b34485dad92c1bf51834b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:23Z,use_quota=True,user_id='988dce951e60443e98c8b52a26c3333e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c75a56-fbc7-4ed6-a135-6f994ed84961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89c75a56-fbc7-4ed6-a135-6f994ed84961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb92ee04-29bc-4a4e-8d08-66a7985c3fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb92ee04-29bc-4a4e-8d08-66a7985c3fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5611495-447b-4844-8e0c-bdbb7ae1726c', 'volume_name': 'volume-e5611495-447b-4844-8e0c-bdbb7ae1726c', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a458877-9a50-4e49-b256-7f7560e8e065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a458877-9a50-4e49-b256-7f7560e8e065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9a6ac9-a946-4482-bab6-4b9b5416a3a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:23 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Volume e5611495-447b-4844-8e0c-bdbb7ae1726c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5611495-447b-4844-8e0c-bdbb7ae1726c', 'volume_size': 1} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-794516733',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5611495-447b-4844-8e0c-bdbb7ae1726c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d3275d47b34485dad92c1bf51834b6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:23Z,use_quota=True,user_id='988dce951e60443e98c8b52a26c3333e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Creating volume e5611495-447b-4844-8e0c-bdbb7ae1726c {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:23 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:28:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:23 devstack sudo[111174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c 1073741824 Jun 19 04:28:23 devstack sudo[111174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:24 devstack sudo[111166]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" returned: 0 in 1.923s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:24 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_48f144f9-8f65-4076-815d-182823d98531_1zp9_pq9devstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:28:24 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Converted 112.00 MB image at 58.19 MB/s Jun 19 04:28:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:24 devstack sudo[111179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a 1G Jun 19 04:28:24 devstack sudo[111179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:24 devstack sudo[111174]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c 1073741824" returned: 0 in 0.917s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:24 devstack sudo[111181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c Jun 19 04:28:24 devstack sudo[111181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:24 devstack sudo[111179]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a 1G" returned: 0 in 0.690s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b108cda-a618-48d8-8561-19d2a677e8ae]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:25 devstack sudo[111181]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c" returned: 0 in 0.640s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] <== create_volume: return (1600ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de9a6ac9-a946-4482-bab6-4b9b5416a3a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5611495-447b-4844-8e0c-bdbb7ae1726c', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187774a-0496-4ebe-b4f8-3d219ac38eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:25 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Volume volume-e5611495-447b-4844-8e0c-bdbb7ae1726c (e5611495-447b-4844-8e0c-bdbb7ae1726c): created successfully Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8187774a-0496-4ebe-b4f8-3d219ac38eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Flow 'volume_create_manager' (30e9301e-63ef-4f76-bb82-eb67a68b630f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:25 devstack sudo[111187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a Jun 19 04:28:25 devstack sudo[111187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1eebd386-2fc8-48a5-adb0-7743bc144efb tempest-VolumesTransfersTest-925226942 None] Created volume successfully. Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Acquiring lock "cinder-e5611495-447b-4844-8e0c-bdbb7ae1726c-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Lock "cinder-e5611495-447b-4844-8e0c-bdbb7ae1726c-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Acquiring lock "cinder-quobyte-e5611495-447b-4844-8e0c-bdbb7ae1726c" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Lock "cinder-quobyte-e5611495-447b-4844-8e0c-bdbb7ae1726c" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[628eb7c1-c6e2-4de7-869d-749f729a10c3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:25 devstack sudo[111187]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" returned: 0 in 0.828s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:25 devstack sudo[111191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c Jun 19 04:28:25 devstack sudo[111191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:25 devstack sudo[111192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a Jun 19 04:28:25 devstack sudo[111192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:26 devstack sudo[111191]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c" returned: 0 in 0.766s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:26 devstack sudo[111201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c Jun 19 04:28:26 devstack sudo[111201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:26 devstack sudo[111192]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" returned: 1 in 0.770s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Downloaded image 48f144f9-8f65-4076-815d-182823d98531 ((None, [{'url': 'file:///opt/stack/data/glance/images/48f144f9-8f65-4076-815d-182823d98531', 'metadata': {}}])) to volume f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a successfully. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Temporary image 48f144f9-8f65-4076-815d-182823d98531 for user caaeb499db6649b09ca07334b4b8ee76 is deleted. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Marking volume f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a as bootable. {{(pid=93769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Copying metadata from image 48f144f9-8f65-4076-815d-182823d98531 to f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a. {{(pid=93769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Creating volume glance metadata for volume f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a backed by image 48f144f9-8f65-4076-815d-182823d98531 with: {'image_id': '48f144f9-8f65-4076-815d-182823d98531', 'image_name': 'tempest-scenario-img--1235277930', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7185f9f1-8a0e-4150-afc3-995ff4474a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a', 'volume_size': 1, 'image_id': '48f144f9-8f65-4076-815d-182823d98531', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/48f144f9-8f65-4076-815d-182823d98531', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1235277930', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '696972796ded49e6ae48379998fbbbe6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '48f144f9-8f65-4076-815d-182823d98531', 'created_at': datetime.datetime(2026, 6, 19, 2, 28, 7, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 28, 9, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/48f144f9-8f65-4076-815d-182823d98531/file', 'properties': {}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd90a079-2f0b-41eb-99c6-981e17b4df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:26 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Volume volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a (f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a): created successfully Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd90a079-2f0b-41eb-99c6-981e17b4df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:26 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Flow 'volume_create_manager' (83a042c4-2661-45bf-8535-6ed05359989f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:26 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-99435470-9234-43d0-b4da-c68b0484f6c9 tempest-TestInstancesWithCinderVolumes-1767651281 None] Created volume successfully. Jun 19 04:28:27 devstack sudo[111201]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e5611495-447b-4844-8e0c-bdbb7ae1726c" returned: 0 in 0.635s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Lock "cinder-quobyte-e5611495-447b-4844-8e0c-bdbb7ae1726c" released by "delete_volume" :: held 1.448s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Created reservations ['3334dc2d-da03-4a01-822d-a66dc2978ea9', '33e48fa0-1d70-4115-ae2d-458495b52275', '833c11ae-1ac4-4842-b24b-034acf578e03', 'cf614b1e-90f0-45c9-aa30-f180b4a66a2c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:27 devstack sudo[111204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:28:27 devstack sudo[111204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:27 devstack sudo[111204]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.681s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:27 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:27 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Deleted volume successfully. Jun 19 04:28:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bfdb348e-b4d7-48e2-bfbb-d330ec111af7 tempest-VolumesTransfersTest-892619019 None] Lock "cinder-e5611495-447b-4844-8e0c-bdbb7ae1726c-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Flow 'volume_create_manager' (4e6005e4-c7cf-409e-8b89-f3324d3838b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707c72d2-0b37-4ace-b69b-3b4584927f55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707c72d2-0b37-4ace-b69b-3b4584927f55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-519781438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3a3906-0dfa-440a-afb3-3a1f942ca065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4550d2bfd4e54a6c848b2a8b9d26c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:35Z,use_quota=True,user_id='f7ecc3569f0a4582b30b59026d1a8548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb673862-c7ac-4fa9-8268-d82b87ff97cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fb673862-c7ac-4fa9-8268-d82b87ff97cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b57a63e-a9c8-48b6-9586-4089fb1f1bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b57a63e-a9c8-48b6-9586-4089fb1f1bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3a3906-0dfa-440a-afb3-3a1f942ca065', 'volume_name': 'volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3871df04-cef9-431a-97ba-c21f078eabe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3871df04-cef9-431a-97ba-c21f078eabe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f392c132-de6a-4cb6-ab47-ca7171b22add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:35 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Volume fb3a3906-0dfa-440a-afb3-3a1f942ca065: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065', 'volume_size': 1} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-519781438',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3a3906-0dfa-440a-afb3-3a1f942ca065,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4550d2bfd4e54a6c848b2a8b9d26c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:35Z,use_quota=True,user_id='f7ecc3569f0a4582b30b59026d1a8548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Creating volume fb3a3906-0dfa-440a-afb3-3a1f942ca065 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:35 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:35 devstack sudo[111218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 1073741824 Jun 19 04:28:35 devstack sudo[111218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:36 devstack sudo[111218]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 1073741824" returned: 0 in 0.975s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=153,cinder:SELECT=114,cinder:INSERT=46,cinder:DELETE=7 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:36 devstack sudo[111228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 Jun 19 04:28:36 devstack sudo[111228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:36 devstack sudo[111228]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065" returned: 0 in 0.651s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.495s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f392c132-de6a-4cb6-ab47-ca7171b22add) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012b545d-5a1f-4364-94f9-11058c86b56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Volume volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 (fb3a3906-0dfa-440a-afb3-3a1f942ca065): created successfully Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (012b545d-5a1f-4364-94f9-11058c86b56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Flow 'volume_create_manager' (4e6005e4-c7cf-409e-8b89-f3324d3838b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c5e4a3-ce97-49fd-9c1f-ac840febe41f]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b5753eaf-a578-4738-8320-0a5da32b4f94 tempest-VolumesTransfersV357Test-915632049 None] Created volume successfully. Jun 19 04:28:37 devstack sudo[111231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a Jun 19 04:28:37 devstack sudo[111231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c0be2daa-9610-4fa9-b4fc-7da5d3ab8386 tempest-VolumesTransfersV357Test-720247757 None] Transfer volume completed successfully. Jun 19 04:28:37 devstack sudo[111231]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" returned: 0 in 0.848s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:37 devstack sudo[111235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a Jun 19 04:28:37 devstack sudo[111235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:38 devstack sudo[111235]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" returned: 1 in 0.797s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.701s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '380253c6-016b-4f23-be7b-43c39c381e58', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:28:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-363a65de-5a0f-4285-a296-29ce08a3f3d8 req-546d1dda-5d80-4f9e-b942-521018497f6e tempest-TestInstancesWithCinderVolumes-1767651281 None] attachment_update completed successfully. Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Acquiring lock "cinder-fb3a3906-0dfa-440a-afb3-3a1f942ca065-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Lock "cinder-fb3a3906-0dfa-440a-afb3-3a1f942ca065-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Acquiring lock "cinder-quobyte-fb3a3906-0dfa-440a-afb3-3a1f942ca065" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Lock "cinder-quobyte-fb3a3906-0dfa-440a-afb3-3a1f942ca065" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ddf039b-eb20-486d-a3f5-074aea179faf]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:38 devstack sudo[111240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 Jun 19 04:28:38 devstack sudo[111240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:39 devstack sudo[111240]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065" returned: 0 in 0.754s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:39 devstack sudo[111245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065 Jun 19 04:28:39 devstack sudo[111245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:40 devstack sudo[111245]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-fb3a3906-0dfa-440a-afb3-3a1f942ca065" returned: 0 in 0.648s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Lock "cinder-quobyte-fb3a3906-0dfa-440a-afb3-3a1f942ca065" released by "delete_volume" :: held 1.441s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Created reservations ['ba23049f-732d-44bd-91e2-febd576d2d6c', '1b927a0b-b22d-472e-afe8-8af81835c0e7', 'cc5ca8b9-aa2c-4480-b853-fced74b2d34b', 'be0a67a8-5104-4eca-8249-593db5c45dd6'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:40 devstack sudo[111248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:28:40 devstack sudo[111248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:40 devstack sudo[111248]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.639s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:40 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Deleted volume successfully. Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-01baa0da-7c3f-4bce-a583-d8d1bd247482 tempest-VolumesTransfersV357Test-1934546072 None] Lock "cinder-fb3a3906-0dfa-440a-afb3-3a1f942ca065-delete_volume" released by "delete_volume" :: held 2.270s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Flow 'volume_create_manager' (99cc8b44-4aa8-4810-88a3-0c18ed33d45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa63880-feff-4750-be49-26c4ddc90c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fa63880-feff-4750-be49-26c4ddc90c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-800966430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da10d846-aaeb-4b5c-93be-a6dd79ea1194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4550d2bfd4e54a6c848b2a8b9d26c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:41Z,use_quota=True,user_id='f7ecc3569f0a4582b30b59026d1a8548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8519d9df-58c2-45f2-b304-aa56a1654632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8519d9df-58c2-45f2-b304-aa56a1654632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fffe6e-7876-4ec0-bdbf-bf4447051cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89fffe6e-7876-4ec0-bdbf-bf4447051cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da10d846-aaeb-4b5c-93be-a6dd79ea1194', 'volume_name': 'volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615cc243-13c1-4943-be2f-fc7e769197b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (615cc243-13c1-4943-be2f-fc7e769197b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a9db22-eed6-4964-86ba-37abfc4a11a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:41 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Volume da10d846-aaeb-4b5c-93be-a6dd79ea1194: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194', 'volume_size': 1} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:28:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-800966430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da10d846-aaeb-4b5c-93be-a6dd79ea1194,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4550d2bfd4e54a6c848b2a8b9d26c82b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:28:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:28:41Z,use_quota=True,user_id='f7ecc3569f0a4582b30b59026d1a8548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Creating volume da10d846-aaeb-4b5c-93be-a6dd79ea1194 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:28:41 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:41 devstack sudo[111320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 1073741824 Jun 19 04:28:41 devstack sudo[111320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:41 devstack sudo[111325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:28:41 devstack sudo[111325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:42 devstack sudo[111320]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 1073741824" returned: 0 in 0.804s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:42 devstack sudo[111330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 Jun 19 04:28:42 devstack sudo[111330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:42 devstack sudo[111325]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.657s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:28:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:28:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:28:43 devstack sudo[111330]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194" returned: 0 in 0.628s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.480s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63a9db22-eed6-4964-86ba-37abfc4a11a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a6bd29-bf34-46a8-8fbf-4929a83ce9a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:28:43 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Volume volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 (da10d846-aaeb-4b5c-93be-a6dd79ea1194): created successfully Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02a6bd29-bf34-46a8-8fbf-4929a83ce9a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Flow 'volume_create_manager' (99cc8b44-4aa8-4810-88a3-0c18ed33d45c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:28:43 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e14f60d5-a92d-4db2-91bd-75977d5567a6 tempest-VolumesTransfersV357Test-915632049 None] Created volume successfully. Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Acquiring lock "cinder-da10d846-aaeb-4b5c-93be-a6dd79ea1194-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Lock "cinder-da10d846-aaeb-4b5c-93be-a6dd79ea1194-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Acquiring lock "cinder-quobyte-da10d846-aaeb-4b5c-93be-a6dd79ea1194" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Lock "cinder-quobyte-da10d846-aaeb-4b5c-93be-a6dd79ea1194" acquired by "delete_volume" :: waited 0.026s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a6da9f-1bfe-4bf5-9a10-45da5a3c8f46]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:28:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:44 devstack sudo[111659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 Jun 19 04:28:44 devstack sudo[111659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:45 devstack sudo[111659]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194" returned: 0 in 1.243s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:45 devstack sudo[111731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194 Jun 19 04:28:45 devstack sudo[111731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:45 devstack sudo[111731]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da10d846-aaeb-4b5c-93be-a6dd79ea1194" returned: 0 in 0.684s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Lock "cinder-quobyte-da10d846-aaeb-4b5c-93be-a6dd79ea1194" released by "delete_volume" :: held 1.975s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:45 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Created reservations ['ed6afcbb-e8be-43e0-a7a7-0d3cf848eaa5', '3be2a240-f202-4ff5-9517-6964ac4c4d4b', 'd3624f8e-fec5-4d86-9862-5ca210d5ca5d', 'a9383cfa-d15a-450b-9f0f-6ce4f8f331f8'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:28:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:28:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:28:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:28:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:28:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:28:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:28:46 devstack sudo[111738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:28:46 devstack sudo[111738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:28:46 devstack sudo[111738]: pam_unix(sudo:session): session closed for user root Jun 19 04:28:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.826s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:28:46 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:28:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Deleted volume successfully. Jun 19 04:28:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f8e8c9cc-3ea9-46ef-98ae-2748befe3696 tempest-VolumesTransfersV357Test-1934546072 None] Lock "cinder-da10d846-aaeb-4b5c-93be-a6dd79ea1194-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:28:55 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=24,cinder:SELECT=17,cinder:INSERT=5,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:28:56 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=41,cinder:UPDATE=47,cinder:INSERT=13,cinder:DELETE=7 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:29:02 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Flow 'volume_create_manager' (82e302de-86a3-43e2-b318-431799cac286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdeabda-5a62-4afd-9319-8aaabf7b9160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ccdeabda-5a62-4afd-9319-8aaabf7b9160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-404423716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82653bffdb4d43e9b7f36ba7f45ad56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:03Z,use_quota=True,user_id='30cf30f74a8e4625852d0af679dc22f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792d11d4-af1a-423a-8cff-371edfcf826e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (792d11d4-af1a-423a-8cff-371edfcf826e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc0f1e2-962d-40f6-b571-a2fe3b71204c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc0f1e2-962d-40f6-b571-a2fe3b71204c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d', 'volume_name': 'volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0c14da-70e0-46ab-a85c-e346a0934480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd0c14da-70e0-46ab-a85c-e346a0934480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3a6cf9-5ede-4d96-9bac-37ea014291d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:03 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Volume e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d', 'volume_size': 1} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-404423716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='82653bffdb4d43e9b7f36ba7f45ad56b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:29:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:29:03Z,use_quota=True,user_id='30cf30f74a8e4625852d0af679dc22f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Creating volume e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:29:03 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:03 devstack sudo[111862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d 1073741824 Jun 19 04:29:03 devstack sudo[111862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:03 devstack sudo[111862]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d 1073741824" returned: 0 in 0.817s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:03 devstack sudo[111867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d Jun 19 04:29:03 devstack sudo[111867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:04 devstack sudo[111867]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" returned: 0 in 0.628s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:29:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab3a6cf9-5ede-4d96-9bac-37ea014291d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063460de-497a-42e7-a106-ccfe0ec114f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:29:04 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Volume volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d (e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d): created successfully Jun 19 04:29:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (063460de-497a-42e7-a106-ccfe0ec114f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:29:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Flow 'volume_create_manager' (82e302de-86a3-43e2-b318-431799cac286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:29:04 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d8ed111f-ee38-4208-a66d-03c64037086a tempest-VolumesActionsTest-467342028 None] Created volume successfully. Jun 19 04:29:14 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=1,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:29:14 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:29:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-0bc3a519-ce99-4bfd-a399-4bc554c12f7a req-2affaebd-c181-413e-9213-5fd75c35c6a8 tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-0bc3a519-ce99-4bfd-a399-4bc554c12f7a req-2affaebd-c181-413e-9213-5fd75c35c6a8 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:18 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[081d0c3d-a6bb-4f94-bb0a-fcd28e09066f]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-0bc3a519-ce99-4bfd-a399-4bc554c12f7a req-2affaebd-c181-413e-9213-5fd75c35c6a8 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:18 devstack sudo[112022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 Jun 19 04:29:18 devstack sudo[112022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:18 devstack sudo[112022]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-0bc3a519-ce99-4bfd-a399-4bc554c12f7a req-2affaebd-c181-413e-9213-5fd75c35c6a8 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8" returned: 0 in 0.882s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-0bc3a519-ce99-4bfd-a399-4bc554c12f7a req-2affaebd-c181-413e-9213-5fd75c35c6a8 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-0bc3a519-ce99-4bfd-a399-4bc554c12f7a req-2affaebd-c181-413e-9213-5fd75c35c6a8 tempest-TestInstancesWithCinderVolumes-1767651281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8417728a-9a05-468b-8c3d-1f2f754291d6', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:29:19 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-0bc3a519-ce99-4bfd-a399-4bc554c12f7a req-2affaebd-c181-413e-9213-5fd75c35c6a8 tempest-TestInstancesWithCinderVolumes-1767651281 None] attachment_update completed successfully. Jun 19 04:29:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-261ea731-d605-43f1-95b2-5c3a09fadfd1 tempest-VolumesActionsTest-467342028 None] Acquiring lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" by "attach_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-261ea731-d605-43f1-95b2-5c3a09fadfd1 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" acquired by "attach_volume" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:20 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-261ea731-d605-43f1-95b2-5c3a09fadfd1 tempest-VolumesActionsTest-467342028 None] Attaching volume e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d to instance c6431701-4e73-4148-aa52-3ab48104189b at mountpoint /dev/vdb on host None. Jun 19 04:29:20 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-261ea731-d605-43f1-95b2-5c3a09fadfd1 tempest-VolumesActionsTest-467342028 None] Attach volume completed successfully. Jun 19 04:29:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-261ea731-d605-43f1-95b2-5c3a09fadfd1 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" released by "attach_volume" :: held 0.098s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-236da623-bc18-4882-8369-e8bf60956386 tempest-VolumesActionsTest-467342028 None] Acquiring lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d-detach_volume" by "detach_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-236da623-bc18-4882-8369-e8bf60956386 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-236da623-bc18-4882-8369-e8bf60956386 tempest-VolumesActionsTest-467342028 None] Detaching volume e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d from instance c6431701-4e73-4148-aa52-3ab48104189b. Jun 19 04:29:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-236da623-bc18-4882-8369-e8bf60956386 tempest-VolumesActionsTest-467342028 None] Detach volume completed successfully. Jun 19 04:29:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-236da623-bc18-4882-8369-e8bf60956386 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-d2e5ad82-6453-4c4c-a58d-ba1283e498bf req-51b983fd-eae6-45bf-b2a8-d64f90342c10 tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-d2e5ad82-6453-4c4c-a58d-ba1283e498bf req-51b983fd-eae6-45bf-b2a8-d64f90342c10 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:27 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[515a61eb-54b6-4825-80fa-4995885df7fc]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-d2e5ad82-6453-4c4c-a58d-ba1283e498bf req-51b983fd-eae6-45bf-b2a8-d64f90342c10 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:27 devstack sudo[112097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 Jun 19 04:29:27 devstack sudo[112097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:28 devstack sudo[112097]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-d2e5ad82-6453-4c4c-a58d-ba1283e498bf req-51b983fd-eae6-45bf-b2a8-d64f90342c10 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204" returned: 0 in 0.798s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-d2e5ad82-6453-4c4c-a58d-ba1283e498bf req-51b983fd-eae6-45bf-b2a8-d64f90342c10 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.815s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-d2e5ad82-6453-4c4c-a58d-ba1283e498bf req-51b983fd-eae6-45bf-b2a8-d64f90342c10 tempest-TestInstancesWithCinderVolumes-1767651281 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-ff71c314-c43f-4f64-b0f3-37af4ae15204', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c235f2e4-0b71-4f1b-87ff-47acf8655aea', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:29:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-d2e5ad82-6453-4c4c-a58d-ba1283e498bf req-51b983fd-eae6-45bf-b2a8-d64f90342c10 tempest-TestInstancesWithCinderVolumes-1767651281 None] attachment_update completed successfully. Jun 19 04:29:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-64260beb-c967-4f31-8ce2-f648c24104a3 req-f62fa9e8-f8f8-4d57-9f57-f7f5927d9076 tempest-TestInstancesWithCinderVolumes-1767651281 None] Terminate volume connection completed successfully. Jun 19 04:29:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-64260beb-c967-4f31-8ce2-f648c24104a3 req-f62fa9e8-f8f8-4d57-9f57-f7f5927d9076 tempest-TestInstancesWithCinderVolumes-1767651281 None] Deleting attachment 8417728a-9a05-468b-8c3d-1f2f754291d6. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:29:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "cinder-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "cinder-quobyte-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-quobyte-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8" acquired by "delete_volume" :: waited 0.012s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[023b4843-09bb-4f5f-8582-30f7d411e0d7]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:39 devstack sudo[112171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 Jun 19 04:29:39 devstack sudo[112171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:39 devstack sudo[112171]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8" returned: 0 in 0.835s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:39 devstack sudo[112179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8 Jun 19 04:29:39 devstack sudo[112179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:40 devstack sudo[112179]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8" returned: 0 in 0.678s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-quobyte-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8" released by "delete_volume" :: held 1.557s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:40 devstack cinder-volume[93769]: WARNING cinder.quota [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2131912297-558156557 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2131912297-558156557, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:29:40 devstack cinder-volume[93769]: WARNING cinder.quota [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2131912297-558156557 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2131912297-558156557, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:29:40 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Created reservations ['e80cf70b-27bd-44e5-861b-dc10158154d9', '081b15e0-f01a-4c2c-9b83-20b696056ae8', 'fe77a4c5-4e13-4663-9a4a-997a5cf18509', '3c0755ee-c284-4797-9d71-d7447a1defab'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:40 devstack sudo[112182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:29:40 devstack sudo[112182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:41 devstack sudo[112182]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.718s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Deleted volume successfully. Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-252ab827-9bf9-4e83-9625-e9b23a3ac92e tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-0ce48cef-0cb7-4b86-9ce7-8425a7a478c8-delete_volume" released by "delete_volume" :: held 2.480s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:41 devstack sudo[112268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:29:41 devstack sudo[112268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:42 devstack sudo[112268]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.888s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:29:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:29:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:29:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9c179345-1415-4467-a3af-189fc96d9199 tempest-VolumesActionsTest-467342028 None] Acquiring lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" by "attach_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9c179345-1415-4467-a3af-189fc96d9199 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" acquired by "attach_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9c179345-1415-4467-a3af-189fc96d9199 tempest-VolumesActionsTest-467342028 None] Attaching volume e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d to instance a597bcea-8704-4a5c-b7c1-651c2bedf68f at mountpoint /dev/vdb on host None. Jun 19 04:29:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9c179345-1415-4467-a3af-189fc96d9199 tempest-VolumesActionsTest-467342028 None] Attach volume completed successfully. Jun 19 04:29:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9c179345-1415-4467-a3af-189fc96d9199 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" released by "attach_volume" :: held 0.088s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c9676eae-bb37-43ff-a496-47270a810e89 tempest-VolumesActionsTest-467342028 None] Acquiring lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d-detach_volume" by "detach_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c9676eae-bb37-43ff-a496-47270a810e89 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c9676eae-bb37-43ff-a496-47270a810e89 tempest-VolumesActionsTest-467342028 None] Detaching volume e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d from instance a597bcea-8704-4a5c-b7c1-651c2bedf68f. Jun 19 04:29:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c9676eae-bb37-43ff-a496-47270a810e89 tempest-VolumesActionsTest-467342028 None] Detach volume completed successfully. Jun 19 04:29:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c9676eae-bb37-43ff-a496-47270a810e89 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d-detach_volume" released by "detach_volume" :: held 0.066s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-8b557f14-c2e6-4377-9fdc-3cdb3afdf6af req-eb2ae130-f920-4da6-be92-4e6b46d5befd tempest-TestInstancesWithCinderVolumes-1767651281 None] Terminate volume connection completed successfully. Jun 19 04:29:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-8b557f14-c2e6-4377-9fdc-3cdb3afdf6af req-eb2ae130-f920-4da6-be92-4e6b46d5befd tempest-TestInstancesWithCinderVolumes-1767651281 None] Deleting attachment c235f2e4-0b71-4f1b-87ff-47acf8655aea. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:29:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "cinder-ff71c314-c43f-4f64-b0f3-37af4ae15204-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-ff71c314-c43f-4f64-b0f3-37af4ae15204-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "cinder-quobyte-ff71c314-c43f-4f64-b0f3-37af4ae15204" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-quobyte-ff71c314-c43f-4f64-b0f3-37af4ae15204" acquired by "delete_volume" :: waited 0.013s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:47 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[340bff7a-f61e-475c-9768-8719c4b025f4]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:48 devstack sudo[112342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 Jun 19 04:29:48 devstack sudo[112342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:48 devstack sudo[112342]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204" returned: 0 in 0.752s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:48 devstack sudo[112348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204 Jun 19 04:29:48 devstack sudo[112348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:49 devstack sudo[112348]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ff71c314-c43f-4f64-b0f3-37af4ae15204" returned: 0 in 0.951s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-quobyte-ff71c314-c43f-4f64-b0f3-37af4ae15204" released by "delete_volume" :: held 1.748s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:49 devstack cinder-volume[93769]: WARNING cinder.quota [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2107278949-1383285833 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2107278949-1383285833, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:29:49 devstack cinder-volume[93769]: WARNING cinder.quota [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2107278949-1383285833 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2107278949-1383285833, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:29:49 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Created reservations ['09e00059-9803-495c-8849-716a29f7aa09', '0dbe770b-a2a3-4420-b68a-c4e311e75242', '733dab8b-549c-45f7-a420-fda8d96a42d5', '9b0c7f4f-4752-4f23-a69e-d14b4b22d76c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:29:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:29:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:29:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:29:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:49 devstack sudo[112354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:29:49 devstack sudo[112354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:50 devstack sudo[112354]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.786s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:50 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:29:50 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Deleted volume successfully. Jun 19 04:29:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-4ef0adfa-6b62-42a1-ade9-d83ab3b114b3 tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-ff71c314-c43f-4f64-b0f3-37af4ae15204-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:29:54 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-093f18ec-98ca-42a9-a824-2387a7a1df85 req-95f41a39-4ec8-475a-98ac-426772dc6967 tempest-TestInstancesWithCinderVolumes-1767651281 None] Terminate volume connection completed successfully. Jun 19 04:29:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-093f18ec-98ca-42a9-a824-2387a7a1df85 req-95f41a39-4ec8-475a-98ac-426772dc6967 tempest-TestInstancesWithCinderVolumes-1767651281 None] Deleting attachment 380253c6-016b-4f23-be7b-43c39c381e58. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:29:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:29:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:29:55 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8160cae5-89aa-4986-94cc-6ffd60dea817]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:55 devstack sudo[112413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d Jun 19 04:29:55 devstack sudo[112413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:55 devstack sudo[112413]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" returned: 0 in 0.722s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:55 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[004710d1-762d-4dd4-8d38-94224f5c0925]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:55 devstack sudo[112419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d Jun 19 04:29:55 devstack sudo[112419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:56 devstack sudo[112419]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" returned: 0 in 0.709s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.a47c9667-c9ac-478a-b224-4f32558919db5clddpzw.img {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:56 devstack sudo[112424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.a47c9667-c9ac-478a-b224-4f32558919db5clddpzw.img Jun 19 04:29:56 devstack sudo[112424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "cinder-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "cinder-quobyte-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:29:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-quobyte-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" acquired by "delete_volume" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:29:58 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08b430e-b460-4b58-a62f-0f6d30696dea]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:29:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:29:58 devstack sudo[112437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a Jun 19 04:29:58 devstack sudo[112437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:29:59 devstack sudo[112437]: pam_unix(sudo:session): session closed for user root Jun 19 04:29:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" returned: 0 in 1.467s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:29:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:00 devstack sudo[112441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a Jun 19 04:30:00 devstack sudo[112441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack sudo[112424]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.a47c9667-c9ac-478a-b224-4f32558919db5clddpzw.img" returned: 0 in 4.435s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0570cf22-eaea-4040-b1e8-a174450ad0f3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:01 devstack sudo[112444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d Jun 19 04:30:01 devstack sudo[112444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack sudo[112441]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" returned: 1 in 1.530s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:01 devstack sudo[112449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a Jun 19 04:30:01 devstack sudo[112449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:01 devstack sudo[112444]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" returned: 0 in 0.899s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d, size 1024.00 MB, duration 4.44 sec, destination /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.a47c9667-c9ac-478a-b224-4f32558919db5clddpzw.img {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:30:01 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Converted 1024.00 MB image at 230.83 MB/s Jun 19 04:30:01 devstack sudo[112449]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] a47c9667-c9ac-478a-b224-4f32558919db was raw, no need to convert to raw {{(pid=93769) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" returned: 0 in 0.612s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-quobyte-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a" released by "delete_volume" :: held 3.742s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:02 devstack cinder-volume[93769]: WARNING cinder.quota [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-471799286-979263513 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-471799286-979263513, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:30:02 devstack cinder-volume[93769]: WARNING cinder.quota [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-471799286-979263513 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-471799286-979263513, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Created reservations ['348a0808-b51e-4c35-942e-0a048a1117c0', 'faa9cd99-3db7-4193-b3b0-1d437057ca56', 'fed23c99-5d86-4e39-a61a-d3059cac8473', 'd55f9d7a-73d7-4539-a342-dd51f5127a86'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:02 devstack sudo[112456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:30:02 devstack sudo[112456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:02 devstack sudo[112456]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.645s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Deleted volume successfully. Jun 19 04:30:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6cc26c0d-22b7-4b4b-a0d9-ff55a733787b tempest-TestInstancesWithCinderVolumes-1767651281 None] Lock "cinder-f5fd9f8e-5446-479b-ae14-b6dc0d85ed9a-delete_volume" released by "delete_volume" :: held 4.682s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:12 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=42,cinder:UPDATE=36,cinder:INSERT=9,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:30:12 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=46,cinder:UPDATE=31,cinder:INSERT=7,cinder:DELETE=2 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:30:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.412s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Uploaded volume to glance image-id: a47c9667-c9ac-478a-b224-4f32558919db. {{(pid=93769) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 19 04:30:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-156380d9-020f-4347-a0f9-467f5286321d tempest-VolumesActionsTest-467342028 None] Copy volume to image completed successfully. Jun 19 04:30:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[783fd514-0ff8-4347-bc2a-bd76c2b590f2]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:24 devstack sudo[112503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d Jun 19 04:30:24 devstack sudo[112503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:25 devstack sudo[112503]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" returned: 0 in 0.797s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:25 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e33562-0a06-4688-be1d-7f92d3307675]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:25 devstack sudo[112509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d Jun 19 04:30:25 devstack sudo[112509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:26 devstack sudo[112509]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" returned: 0 in 0.762s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:26 devstack sudo[112514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img Jun 19 04:30:26 devstack sudo[112514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:30 devstack sudo[112514]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img" returned: 0 in 4.919s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:30 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4e4aa3-b6b7-4629-993e-8c961a5b6cdb]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:31 devstack sudo[112527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d Jun 19 04:30:31 devstack sudo[112527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:32 devstack sudo[112527]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" returned: 0 in 1.068s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:32 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d, size 1024.00 MB, duration 4.92 sec, destination /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:30:32 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Converted 1024.00 MB image at 208.11 MB/s Jun 19 04:30:32 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] b9a618df-79ec-41c8-bef6-4db71f52c8dd was raw, converting to qcow2 {{(pid=93769) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jun 19 04:30:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6c0060-18fc-4a2b-9eca-af2fb334f203]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:32 devstack sudo[112533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img Jun 19 04:30:32 devstack sudo[112533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:32 devstack sudo[112533]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img" returned: 0 in 0.738s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:32 devstack sudo[112537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img Jun 19 04:30:32 devstack sudo[112537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:33 devstack sudo[112537]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img" returned: 1 in 0.855s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:30:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img /opt/stack/data/cinder/conversion/vol_upload_bb5rawh1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:33 devstack sudo[112542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img /opt/stack/data/cinder/conversion/vol_upload_bb5rawh1 Jun 19 04:30:33 devstack sudo[112542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:34 devstack sudo[112542]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img /opt/stack/data/cinder/conversion/vol_upload_bb5rawh1" returned: 0 in 0.699s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:34 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Image conversion details: src /opt/stack/data/cinder/conversion/e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d.temp_image.b9a618df-79ec-41c8-bef6-4db71f52c8ddd1fx_0qz.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_bb5rawh1 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:30:34 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Converted 1024.00 MB image at 1024.00 MB/s Jun 19 04:30:34 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b319cb64-1868-419c-aeda-1716c84227ec]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bb5rawh1 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:34 devstack sudo[112547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bb5rawh1 Jun 19 04:30:34 devstack sudo[112547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:35 devstack sudo[112547]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_bb5rawh1" returned: 0 in 0.838s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.270s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Uploaded volume to glance image-id: b9a618df-79ec-41c8-bef6-4db71f52c8dd. {{(pid=93769) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jun 19 04:30:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-2403a635-1cca-4da3-b509-f725922d7b23 tempest-VolumesActionsTest-467342028 None] Copy volume to image completed successfully. Jun 19 04:30:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Acquiring lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Acquiring lock "cinder-quobyte-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:30:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Lock "cinder-quobyte-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" acquired by "delete_volume" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:30:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cdd6f90-9f7d-4586-b726-17d90fdc05cc]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:30:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:38 devstack sudo[112554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d Jun 19 04:30:38 devstack sudo[112554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:39 devstack sudo[112554]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" returned: 0 in 0.805s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:39 devstack sudo[112562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d Jun 19 04:30:39 devstack sudo[112562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:39 devstack sudo[112562]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" returned: 0 in 0.668s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Lock "cinder-quobyte-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d" released by "delete_volume" :: held 1.517s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Created reservations ['e08745f4-fe0f-41e8-b844-36564291c683', 'af0f9e1e-c196-43ae-bd3d-c12b537a621f', '767899ff-ec69-41f9-80a3-44ecb14fd490', '71783110-997d-448e-8669-618511ee99fc'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:30:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:30:39 devstack sudo[112565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:30:39 devstack sudo[112565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:30:40 devstack sudo[112565]: pam_unix(sudo:session): session closed for user root Jun 19 04:30:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.706s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:30:40 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:30:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Deleted volume successfully. Jun 19 04:30:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-55360024-5dfe-4d55-8e92-32f24a242508 tempest-VolumesActionsTest-467342028 None] Lock "cinder-e3ccaaf6-5301-43f4-9bb9-eab55fb3b10d-delete_volume" released by "delete_volume" :: held 2.420s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:30:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:30:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:30:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:30:49 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=7,cinder:UPDATE=10,cinder:INSERT=2 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:30:50 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=8,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Flow 'volume_create_manager' (64741eb5-e4b9-4d06-b8d0-8a6efd37c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64b505e-669c-497a-ba97-68b616f0a76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d64b505e-669c-497a-ba97-68b616f0a76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-961109173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b714818-4900-4233-8d44-d190d100a71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a871a5fca6a4bcc8ab19530016cd1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:10Z,use_quota=True,user_id='72ff4e5f7443477294f55539430027c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcefee2-ef47-4b06-af56-10f38f5461ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdcefee2-ef47-4b06-af56-10f38f5461ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f772dfdd-4996-4539-b343-a915c38c4d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.image.glance [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Creating Keystone auth plugin from conf {{(pid=93769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f772dfdd-4996-4539-b343-a915c38c4d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '3b714818-4900-4233-8d44-d190d100a71a', 'volume_name': 'volume-3b714818-4900-4233-8d44-d190d100a71a', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab43b3cc-4a0e-4f3b-8d54-475bf4d4910a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab43b3cc-4a0e-4f3b-8d54-475bf4d4910a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18ced2c-0c12-4a45-9d73-5636db4e6f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:09 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Volume 3b714818-4900-4233-8d44-d190d100a71a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-3b714818-4900-4233-8d44-d190d100a71a', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jun 19 04:31:09 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Trying to clone 3b714818-4900-4233-8d44-d190d100a71a from image f472f64e-f7ec-4170-b06c-8de073bddf2f at location (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]). {{(pid=93769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:31:10 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:31:10 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Image download 20.69 MB at 20.69 MB/s Jun 19 04:31:10 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[396b81e3-935f-45d3-95ae-a506f9a259ac]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:10 devstack sudo[112719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD Jun 19 04:31:10 devstack sudo[112719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:11 devstack sudo[112719]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD" returned: 0 in 0.723s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Temporary image f472f64e-f7ec-4170-b06c-8de073bddf2f is fetched for user 72ff4e5f7443477294f55539430027c6. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a76eb7a-c10b-4936-bf6e-5734d0d5b349]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:11 devstack sudo[112724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD Jun 19 04:31:11 devstack sudo[112724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:11 devstack sudo[112724]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD" returned: 0 in 0.694s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-961109173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b714818-4900-4233-8d44-d190d100a71a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5a871a5fca6a4bcc8ab19530016cd1ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:10Z,use_quota=True,user_id='72ff4e5f7443477294f55539430027c6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Creating volume 3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:11 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:31:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:11 devstack sudo[112730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a 1073741824 Jun 19 04:31:11 devstack sudo[112730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:12 devstack sudo[112730]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a 1073741824" returned: 0 in 0.766s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:12 devstack sudo[112736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a Jun 19 04:31:12 devstack sudo[112736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:13 devstack sudo[112736]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a" returned: 0 in 0.598s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:13 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:31:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:13 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Attempting download of f472f64e-f7ec-4170-b06c-8de073bddf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}])) to volume 3b714818-4900-4233-8d44-d190d100a71a. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:31:13 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bd9f4a5-037e-4aee-91f4-6a62b44181da]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_dajogev0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:13 devstack sudo[112739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_dajogev0 Jun 19 04:31:13 devstack sudo[112739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:14 devstack sudo[112739]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_dajogev0" returned: 0 in 0.779s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_dajogev0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:14 devstack sudo[112743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_dajogev0 Jun 19 04:31:14 devstack sudo[112743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:14 devstack sudo[112743]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_dajogev0" returned: 1 in 0.758s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f472f64e-f7ec-4170-b06c-8de073bddf2f_dajogev0' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:31:14 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa645c86-ebed-4075-a644-8bc39bf17af7]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:15 devstack sudo[112781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD Jun 19 04:31:15 devstack sudo[112781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:15 devstack sudo[112781]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD" returned: 0 in 0.784s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:15 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] f472f64e-f7ec-4170-b06c-8de073bddf2f was qcow2, converting to raw {{(pid=93769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:31:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:15 devstack sudo[112788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a Jun 19 04:31:15 devstack sudo[112788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:17 devstack sudo[112788]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a" returned: 0 in 1.804s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:17 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f472f64e-f7ec-4170-b06c-8de073bddf2f_o4c1gu02devstack@QuobyteHD, size 112.00 MB, duration 1.81 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:31:17 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Converted 112.00 MB image at 62.03 MB/s Jun 19 04:31:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:17 devstack sudo[112799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a 1G Jun 19 04:31:17 devstack sudo[112799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:18 devstack sudo[112799]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a 1G" returned: 0 in 0.682s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:18 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d57f893-d965-4893-8e0f-ffb1579e53fb]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:18 devstack sudo[112804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a Jun 19 04:31:18 devstack sudo[112804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:18 devstack sudo[112804]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a" returned: 0 in 0.794s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:19 devstack sudo[112810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a Jun 19 04:31:19 devstack sudo[112810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Flow 'volume_create_manager' (b3f2aaf5-bb16-4949-9d3e-96c40602759b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7921fd8c-13f2-4f25-b93c-ae3a1de620f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7921fd8c-13f2-4f25-b93c-ae3a1de620f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-499332882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ca2648d0d0433fb0eabdb017abb3bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:20Z,use_quota=True,user_id='44a6f45d632645448beb95edc4a5fe71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a743ab2-fdbf-4843-acaf-b558bfe97eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a743ab2-fdbf-4843-acaf-b558bfe97eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27ed999-b255-40e1-b598-309999d0c352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a27ed999-b255-40e1-b598-309999d0c352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16', 'volume_name': 'volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237e2e60-13bf-48b5-bace-8e4670956c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (237e2e60-13bf-48b5-bace-8e4670956c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba972a-8ca3-4e6e-8924-d29c2854e2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:19 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Volume ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16', 'volume_size': 1} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-499332882',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17ca2648d0d0433fb0eabdb017abb3bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:31:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:31:20Z,use_quota=True,user_id='44a6f45d632645448beb95edc4a5fe71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Creating volume ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:31:19 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:19 devstack sudo[112815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 1073741824 Jun 19 04:31:19 devstack sudo[112815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:19 devstack sudo[112810]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a" returned: 1 in 0.781s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Downloaded image f472f64e-f7ec-4170-b06c-8de073bddf2f ((None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}])) to volume 3b714818-4900-4233-8d44-d190d100a71a successfully. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Temporary image f472f64e-f7ec-4170-b06c-8de073bddf2f for user 72ff4e5f7443477294f55539430027c6 is deleted. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Marking volume 3b714818-4900-4233-8d44-d190d100a71a as bootable. {{(pid=93769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Copying metadata from image f472f64e-f7ec-4170-b06c-8de073bddf2f to 3b714818-4900-4233-8d44-d190d100a71a. {{(pid=93769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Creating volume glance metadata for volume 3b714818-4900-4233-8d44-d190d100a71a backed by image f472f64e-f7ec-4170-b06c-8de073bddf2f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=93769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d18ced2c-0c12-4a45-9d73-5636db4e6f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b714818-4900-4233-8d44-d190d100a71a', 'volume_size': 1, 'image_id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f472f64e-f7ec-4170-b06c-8de073bddf2f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ef6345a6e09442c6ab984aad1b632be4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f472f64e-f7ec-4170-b06c-8de073bddf2f', 'created_at': datetime.datetime(2026, 6, 19, 2, 6, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 6, 21, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f472f64e-f7ec-4170-b06c-8de073bddf2f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8656f1-40a0-4cb8-89de-8deeb3ce6511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:19 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Volume volume-3b714818-4900-4233-8d44-d190d100a71a (3b714818-4900-4233-8d44-d190d100a71a): created successfully Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f8656f1-40a0-4cb8-89de-8deeb3ce6511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:19 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Flow 'volume_create_manager' (64741eb5-e4b9-4d06-b8d0-8a6efd37c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:19 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-443e1425-9016-4cc1-a0b0-cd8d8374c03c tempest-TestShelveInstance-305874053 None] Created volume successfully. Jun 19 04:31:20 devstack sudo[112815]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 1073741824" returned: 0 in 0.894s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:20 devstack sudo[112820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 Jun 19 04:31:20 devstack sudo[112820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:21 devstack sudo[112820]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16" returned: 0 in 0.739s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] <== create_volume: return (1678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:31:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.680s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceba972a-8ca3-4e6e-8924-d29c2854e2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c557482c-929c-492e-888a-6080533f79b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:21 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Volume volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 (ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16): created successfully Jun 19 04:31:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c557482c-929c-492e-888a-6080533f79b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Flow 'volume_create_manager' (b3f2aaf5-bb16-4949-9d3e-96c40602759b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-eccc23d4-8874-4dc7-b996-ba83036533a8 tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Created volume successfully. Jun 19 04:31:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-920d7c97-2b15-489e-b00e-fa2308df8bcf req-b877acae-b6fe-414a-9397-7cc3cfb0909d tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-920d7c97-2b15-489e-b00e-fa2308df8bcf req-b877acae-b6fe-414a-9397-7cc3cfb0909d tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb1566d-5b43-4404-a875-d951ec64c2a1]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-920d7c97-2b15-489e-b00e-fa2308df8bcf req-b877acae-b6fe-414a-9397-7cc3cfb0909d tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:25 devstack sudo[112838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 Jun 19 04:31:25 devstack sudo[112838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:25 devstack sudo[112838]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-920d7c97-2b15-489e-b00e-fa2308df8bcf req-b877acae-b6fe-414a-9397-7cc3cfb0909d tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16" returned: 0 in 0.786s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-920d7c97-2b15-489e-b00e-fa2308df8bcf req-b877acae-b6fe-414a-9397-7cc3cfb0909d tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.802s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-920d7c97-2b15-489e-b00e-fa2308df8bcf req-b877acae-b6fe-414a-9397-7cc3cfb0909d tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40b22ec7-30ba-4375-b2e1-fc71213bdc3a', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:31:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-920d7c97-2b15-489e-b00e-fa2308df8bcf req-b877acae-b6fe-414a-9397-7cc3cfb0909d tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] attachment_update completed successfully. Jun 19 04:31:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:27 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8d8596-f4f6-4fe5-9086-25c6aa7ed6a0]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:27 devstack sudo[113236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a Jun 19 04:31:27 devstack sudo[113236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:28 devstack sudo[113236]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:28 devstack sudo[113241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a Jun 19 04:31:28 devstack sudo[113241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:28 devstack sudo[113241]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a" returned: 1 in 0.796s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:31:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.637s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:28 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c', 'name': 'volume-3b714818-4900-4233-8d44-d190d100a71a', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0fe36e58-ff4f-4622-9a88-70872cdf1947', 'enforce_multipath': True} {{(pid=93769) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jun 19 04:31:29 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-2a10b737-8083-445d-942a-6194b4a8c93f req-1dc7198b-b4a0-42d1-a135-29a875e33d7c tempest-TestShelveInstance-305874053 None] attachment_update completed successfully. Jun 19 04:31:33 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-7f82e4f2-bde6-454f-87ac-fe1feb820c20 req-8f4fa0c8-7317-4dc7-b37f-be20951754fd tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Terminate volume connection completed successfully. Jun 19 04:31:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-7f82e4f2-bde6-454f-87ac-fe1feb820c20 req-8f4fa0c8-7317-4dc7-b37f-be20951754fd tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Deleting attachment 40b22ec7-30ba-4375-b2e1-fc71213bdc3a. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:31:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Acquiring lock "cinder-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "cinder-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Acquiring lock "cinder-quobyte-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "cinder-quobyte-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[99744eaa-d93b-4992-9c6f-a4a7f06dafda]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:35 devstack sudo[113307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 Jun 19 04:31:35 devstack sudo[113307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:35 devstack sudo[113307]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16" returned: 0 in 0.748s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:35 devstack sudo[113313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16 Jun 19 04:31:35 devstack sudo[113313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:35 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-2a10b737-8083-445d-942a-6194b4a8c93f req-16150c68-a4df-45ba-a7ac-6889cb00369a tempest-TestShelveInstance-305874053 None] Terminate volume connection completed successfully. Jun 19 04:31:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [req-2a10b737-8083-445d-942a-6194b4a8c93f req-16150c68-a4df-45ba-a7ac-6889cb00369a tempest-TestShelveInstance-305874053 None] Deleting attachment 0fe36e58-ff4f-4622-9a88-70872cdf1947. {{(pid=93769) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jun 19 04:31:36 devstack sudo[113313]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16" returned: 0 in 0.636s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "cinder-quobyte-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16" released by "delete_volume" :: held 1.425s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:36 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Created reservations ['0486c97a-d6c4-4895-a6df-a72309c6c8c4', '575cac3f-4430-45aa-806b-5c44c2c97fbc', 'e26975a7-2209-46e4-b21c-acd5d184c384', '7bddb77c-9b40-4d2f-98fd-512f0e802420'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:36 devstack sudo[113316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:31:36 devstack sudo[113316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:37 devstack sudo[113316]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.656s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:37 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Deleted volume successfully. Jun 19 04:31:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0426923d-6c48-466c-ade5-35df95a65e4f tempest-TestServerVolumeAttachScenarioOldVersion-1847700613 None] Lock "cinder-ffd060fe-e691-4ea5-b4ac-efe8ef6b6b16-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:31:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:41 devstack sudo[113368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:31:41 devstack sudo[113368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:42 devstack sudo[113368]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.659s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Acquiring lock "cinder-3b714818-4900-4233-8d44-d190d100a71a-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Lock "cinder-3b714818-4900-4233-8d44-d190d100a71a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Acquiring lock "cinder-quobyte-3b714818-4900-4233-8d44-d190d100a71a" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Lock "cinder-quobyte-3b714818-4900-4233-8d44-d190d100a71a" acquired by "delete_volume" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[58696311-eb02-4f13-a5a8-c2813955e8c9]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:31:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:43 devstack sudo[113371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a Jun 19 04:31:43 devstack sudo[113371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:43 devstack sudo[113371]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:43 devstack sudo[113377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a Jun 19 04:31:43 devstack sudo[113377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a" returned: 1 in 0.815s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:31:44 devstack sudo[113377]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:44 devstack sudo[113382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a Jun 19 04:31:44 devstack sudo[113382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:45 devstack sudo[113382]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3b714818-4900-4233-8d44-d190d100a71a" returned: 0 in 0.751s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Lock "cinder-quobyte-3b714818-4900-4233-8d44-d190d100a71a" released by "delete_volume" :: held 2.446s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:45 devstack cinder-volume[93769]: DEBUG cinder.quota [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Created reservations ['506b3dea-8ce1-4171-8936-a9d437538027', 'f39b1aa9-af67-4017-af75-a199b90904c6', 'c562e3cc-3a3c-4cea-9d27-e59a95a6535b', 'c93db882-0cb5-48b5-9011-a7a1e716a897'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:31:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:31:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:31:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:31:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:31:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:31:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:31:45 devstack sudo[113386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:31:45 devstack sudo[113386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:31:46 devstack sudo[113386]: pam_unix(sudo:session): session closed for user root Jun 19 04:31:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.726s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:31:46 devstack cinder-volume[93769]: DEBUG cinder.manager [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:31:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Deleted volume successfully. Jun 19 04:31:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [req-7eda64fd-d3d3-4eff-98c8-1a2eb313c19c req-2e0fd532-e0a0-4e66-8b8f-e9a7c2b024d7 tempest-TestShelveInstance-305874053 None] Lock "cinder-3b714818-4900-4233-8d44-d190d100a71a-delete_volume" released by "delete_volume" :: held 3.465s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:31:55 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=33,cinder:INSERT=12,cinder:UPDATE=24,cinder:DELETE=2 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:56 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=37,cinder:UPDATE=30,cinder:INSERT=11,cinder:DELETE=2 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:31:59 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:31:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Flow 'volume_create_manager' (99b237ed-f906-40a2-9d65-b62ecd7ccf78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:31:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c595df-c064-40a3-985a-e054a7d154da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2c595df-c064-40a3-985a-e054a7d154da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1891c37e-a073-4246-8696-73ade19f8355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed598e6357964571ac25232a1b90d25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:00Z,use_quota=True,user_id='e77178e4c47b41b1b55be159f26fd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddae423c-d348-4247-a4a3-f491ad5f3ead),volume_type_id=ddae423c-d348-4247-a4a3-f491ad5f3ead)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc87110-d0b7-4180-8fe1-b02af26c7a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfc87110-d0b7-4180-8fe1-b02af26c7a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:31:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f427d1fa-548f-496d-b29d-e3aac5438113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:31:59 devstack cinder-volume[93769]: DEBUG cinder.image.glance [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Creating Keystone auth plugin from conf {{(pid=93769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f427d1fa-548f-496d-b29d-e3aac5438113) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1891c37e-a073-4246-8696-73ade19f8355', 'volume_name': 'volume-1891c37e-a073-4246-8696-73ade19f8355', 'volume_size': 1, 'image_id': 'f48490c4-9912-4c35-b5c2-7016184b81f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48490c4-9912-4c35-b5c2-7016184b81f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2d26fe88f981a735ca0f29cd4cbc92c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed598e6357964571ac25232a1b90d25d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6de1eb4ff240cd896bf1689a0e2f8bf1cb800cddc7b62e1fd3d25164eefb0cc0f654c6a0fdd9ab29f52bbf58b7e005082f662e7a14b4fbb70fc141afa0e7e3a2', 'id': 'f48490c4-9912-4c35-b5c2-7016184b81f4', 'created_at': datetime.datetime(2026, 6, 19, 2, 31, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 31, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48490c4-9912-4c35-b5c2-7016184b81f4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c26ecea-0bf5-41f9-ae12-51d84c7caf3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c26ecea-0bf5-41f9-ae12-51d84c7caf3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f803ecfa-9e66-4528-a803-a7f8916a47c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:00 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Volume 1891c37e-a073-4246-8696-73ade19f8355: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1891c37e-a073-4246-8696-73ade19f8355', 'volume_size': 1, 'image_id': 'f48490c4-9912-4c35-b5c2-7016184b81f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48490c4-9912-4c35-b5c2-7016184b81f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2d26fe88f981a735ca0f29cd4cbc92c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed598e6357964571ac25232a1b90d25d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6de1eb4ff240cd896bf1689a0e2f8bf1cb800cddc7b62e1fd3d25164eefb0cc0f654c6a0fdd9ab29f52bbf58b7e005082f662e7a14b4fbb70fc141afa0e7e3a2', 'id': 'f48490c4-9912-4c35-b5c2-7016184b81f4', 'created_at': datetime.datetime(2026, 6, 19, 2, 31, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 31, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48490c4-9912-4c35-b5c2-7016184b81f4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Trying to clone 1891c37e-a073-4246-8696-73ade19f8355 from image f48490c4-9912-4c35-b5c2-7016184b81f4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f48490c4-9912-4c35-b5c2-7016184b81f4', 'metadata': {}}]). {{(pid=93769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:32:00 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2139f60a-6d36-49d8-893d-5b26d53be8d6]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:00 devstack sudo[113405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD Jun 19 04:32:00 devstack sudo[113405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:00 devstack sudo[113405]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD" returned: 0 in 0.748s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:01 devstack sudo[113409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD Jun 19 04:32:01 devstack sudo[113409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:01 devstack sudo[113409]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD" returned: 1 in 0.828s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:32:01 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Temporary image f48490c4-9912-4c35-b5c2-7016184b81f4 is fetched for user e77178e4c47b41b1b55be159f26fd5d3. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:32:01 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[542fda4c-515d-4173-85b4-62fca4910668]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:01 devstack sudo[113415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD Jun 19 04:32:01 devstack sudo[113415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:02 devstack sudo[113415]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD" returned: 0 in 0.777s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:02 devstack sudo[113419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD Jun 19 04:32:02 devstack sudo[113419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:03 devstack sudo[113419]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD" returned: 1 in 0.788s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:31:59Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1891c37e-a073-4246-8696-73ade19f8355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed598e6357964571ac25232a1b90d25d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:00Z,use_quota=True,user_id='e77178e4c47b41b1b55be159f26fd5d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ddae423c-d348-4247-a4a3-f491ad5f3ead),volume_type_id=ddae423c-d348-4247-a4a3-f491ad5f3ead)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Creating volume 1891c37e-a073-4246-8696-73ade19f8355 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:03 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:32:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:03 devstack sudo[113424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 1073741824 Jun 19 04:32:03 devstack sudo[113424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:04 devstack sudo[113424]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 1073741824" returned: 0 in 0.828s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:04 devstack sudo[113429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 Jun 19 04:32:04 devstack sudo[113429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:05 devstack sudo[113429]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355" returned: 0 in 0.695s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.579s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:05 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Attempting download of f48490c4-9912-4c35-b5c2-7016184b81f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48490c4-9912-4c35-b5c2-7016184b81f4', 'metadata': {}}])) to volume 1891c37e-a073-4246-8696-73ade19f8355. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:32:05 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e9ed09-93c6-46f6-9c72-faa9eab64fea]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48490c4-9912-4c35-b5c2-7016184b81f4_1e31cehr {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:05 devstack sudo[113432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48490c4-9912-4c35-b5c2-7016184b81f4_1e31cehr Jun 19 04:32:05 devstack sudo[113432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:05 devstack sudo[113432]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48490c4-9912-4c35-b5c2-7016184b81f4_1e31cehr" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48490c4-9912-4c35-b5c2-7016184b81f4_1e31cehr {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:06 devstack sudo[113436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48490c4-9912-4c35-b5c2-7016184b81f4_1e31cehr Jun 19 04:32:06 devstack sudo[113436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:06 devstack sudo[113436]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48490c4-9912-4c35-b5c2-7016184b81f4_1e31cehr" returned: 1 in 0.761s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48490c4-9912-4c35-b5c2-7016184b81f4_1e31cehr' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:32:06 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[028b1bdb-5c04-489d-89be-b47c9caf3d69]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:06 devstack sudo[113440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD Jun 19 04:32:06 devstack sudo[113440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:07 devstack sudo[113440]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD" returned: 0 in 0.720s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:07 devstack sudo[113444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD Jun 19 04:32:07 devstack sudo[113444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:08 devstack sudo[113444]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD" returned: 1 in 0.739s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:32:08 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] f48490c4-9912-4c35-b5c2-7016184b81f4 was raw, converting to raw {{(pid=93769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:32:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:08 devstack sudo[113449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 Jun 19 04:32:08 devstack sudo[113449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:08 devstack sudo[113449]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355" returned: 0 in 0.721s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:08 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f48490c4-9912-4c35-b5c2-7016184b81f4_w107a4u7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:32:08 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:32:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:08 devstack sudo[113454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 1G Jun 19 04:32:08 devstack sudo[113454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:09 devstack sudo[113454]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 1G" returned: 0 in 0.678s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:09 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db93109-6b85-4dcb-a5be-8093e7e1b626]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:09 devstack sudo[113459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 Jun 19 04:32:09 devstack sudo[113459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:10 devstack sudo[113459]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355" returned: 0 in 0.871s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:10 devstack sudo[113463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 Jun 19 04:32:10 devstack sudo[113463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:11 devstack sudo[113463]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355" returned: 1 in 0.818s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Downloaded image f48490c4-9912-4c35-b5c2-7016184b81f4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48490c4-9912-4c35-b5c2-7016184b81f4', 'metadata': {}}])) to volume 1891c37e-a073-4246-8696-73ade19f8355 successfully. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Temporary image f48490c4-9912-4c35-b5c2-7016184b81f4 for user e77178e4c47b41b1b55be159f26fd5d3 is deleted. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Marking volume 1891c37e-a073-4246-8696-73ade19f8355 as bootable. {{(pid=93769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Copying metadata from image f48490c4-9912-4c35-b5c2-7016184b81f4 to 1891c37e-a073-4246-8696-73ade19f8355. {{(pid=93769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Creating volume glance metadata for volume 1891c37e-a073-4246-8696-73ade19f8355 backed by image f48490c4-9912-4c35-b5c2-7016184b81f4 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f48490c4-9912-4c35-b5c2-7016184b81f4', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a2d26fe88f981a735ca0f29cd4cbc92c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f803ecfa-9e66-4528-a803-a7f8916a47c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1891c37e-a073-4246-8696-73ade19f8355', 'volume_size': 1, 'image_id': 'f48490c4-9912-4c35-b5c2-7016184b81f4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48490c4-9912-4c35-b5c2-7016184b81f4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a2d26fe88f981a735ca0f29cd4cbc92c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed598e6357964571ac25232a1b90d25d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6de1eb4ff240cd896bf1689a0e2f8bf1cb800cddc7b62e1fd3d25164eefb0cc0f654c6a0fdd9ab29f52bbf58b7e005082f662e7a14b4fbb70fc141afa0e7e3a2', 'id': 'f48490c4-9912-4c35-b5c2-7016184b81f4', 'created_at': datetime.datetime(2026, 6, 19, 2, 31, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 31, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48490c4-9912-4c35-b5c2-7016184b81f4/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024917aa-1ec9-444f-b884-f0101f9c3bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:11 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Volume volume-1891c37e-a073-4246-8696-73ade19f8355 (1891c37e-a073-4246-8696-73ade19f8355): created successfully Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (024917aa-1ec9-444f-b884-f0101f9c3bc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Flow 'volume_create_manager' (99b237ed-f906-40a2-9d65-b62ecd7ccf78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:11 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-2e97b776-db24-48fe-b1a3-28632a913064 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Created volume successfully. Jun 19 04:32:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Acquiring lock "cinder-1891c37e-a073-4246-8696-73ade19f8355-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "cinder-1891c37e-a073-4246-8696-73ade19f8355-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Acquiring lock "cinder-quobyte-1891c37e-a073-4246-8696-73ade19f8355" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "cinder-quobyte-1891c37e-a073-4246-8696-73ade19f8355" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:12 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[20cd18ea-adef-46d0-b43f-68dbf9e5dd84]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:12 devstack sudo[113469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 Jun 19 04:32:12 devstack sudo[113469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:13 devstack sudo[113469]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355" returned: 0 in 0.863s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:13 devstack sudo[113473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 Jun 19 04:32:13 devstack sudo[113473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:14 devstack sudo[113473]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355" returned: 1 in 0.894s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:14 devstack sudo[113478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355 Jun 19 04:32:14 devstack sudo[113478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Flow 'volume_create_manager' (04262419-a89f-414d-af46-2256f8b127cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df13e28-ccf3-4496-9fa2-f443b99568d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df13e28-ccf3-4496-9fa2-f443b99568d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1112542194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566c4555-9b6c-4390-aaeb-97dc1443df78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1fe513141a548248b01250e7ae79d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:15Z,use_quota=True,user_id='f136ab988d764898875d4002159649fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077c1e58-22c5-4682-ae60-69ceedbf1d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (077c1e58-22c5-4682-ae60-69ceedbf1d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf42e531-abb7-41e8-a83b-4f30487c8c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf42e531-abb7-41e8-a83b-4f30487c8c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566c4555-9b6c-4390-aaeb-97dc1443df78', 'volume_name': 'volume-566c4555-9b6c-4390-aaeb-97dc1443df78', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41c2ad7-b947-4eec-815a-bb5d66b7465b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c41c2ad7-b947-4eec-815a-bb5d66b7465b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda199d2-e657-4bf3-8671-080187dd80c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:14 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Volume 566c4555-9b6c-4390-aaeb-97dc1443df78: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566c4555-9b6c-4390-aaeb-97dc1443df78', 'volume_size': 1} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1112542194',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=566c4555-9b6c-4390-aaeb-97dc1443df78,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1fe513141a548248b01250e7ae79d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:15Z,use_quota=True,user_id='f136ab988d764898875d4002159649fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Creating volume 566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:14 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:32:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:15 devstack sudo[113480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 1073741824 Jun 19 04:32:15 devstack sudo[113480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:15 devstack sudo[113478]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1891c37e-a073-4246-8696-73ade19f8355" returned: 0 in 0.715s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "cinder-quobyte-1891c37e-a073-4246-8696-73ade19f8355" released by "delete_volume" :: held 2.537s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:15 devstack cinder-volume[93769]: WARNING cinder.quota [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:32:15 devstack cinder-volume[93769]: WARNING cinder.quota [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Created reservations ['2dca3b64-5cd2-48a6-9af2-b1f7a3aa5b40', 'eb4ab3ba-5b36-46af-bbf2-6f2a51f58b4b', 'a0de25da-0540-452e-b697-2088b9d7c293', 'c48cbd5d-815d-4d11-b784-e5bfc26139be'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:15 devstack sudo[113517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:32:15 devstack sudo[113517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:15 devstack sudo[113480]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 1073741824" returned: 0 in 0.852s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:15 devstack sudo[113524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 Jun 19 04:32:15 devstack sudo[113524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:16 devstack sudo[113517]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.693s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:16 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Deleted volume successfully. Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8086a92f-f669-4538-94a5-702e3cbaeec3 tempest-VolumeAndVolumeTypeFromImageTest-872966803 None] Lock "cinder-1891c37e-a073-4246-8696-73ade19f8355-delete_volume" released by "delete_volume" :: held 3.477s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:16 devstack sudo[113524]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78" returned: 0 in 0.695s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.607s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bda199d2-e657-4bf3-8671-080187dd80c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566c4555-9b6c-4390-aaeb-97dc1443df78', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eeb743c-b768-4ae5-8cd0-0fe225db23d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:16 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Volume volume-566c4555-9b6c-4390-aaeb-97dc1443df78 (566c4555-9b6c-4390-aaeb-97dc1443df78): created successfully Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eeb743c-b768-4ae5-8cd0-0fe225db23d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:16 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Flow 'volume_create_manager' (04262419-a89f-414d-af46-2256f8b127cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:16 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-75a085d5-59ed-4b2b-af64-fc0a263dbc22 tempest-SnapshotDependencyTests-1139300417 None] Created volume successfully. Jun 19 04:32:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Creating offline snapshot 5a519fed-16a1-4b92-9ab8-523b0d94a1f6 of volume 566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:32:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f84d7ae-a4f4-4ff0-a190-43d8a06e81fb]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:17 devstack sudo[113528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 Jun 19 04:32:17 devstack sudo[113528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78" returned: 0 in 0.794s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:18 devstack sudo[113528]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:18 devstack sudo[113533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 1G Jun 19 04:32:18 devstack sudo[113533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:18 devstack sudo[113533]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 1G" returned: 0 in 0.823s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-566c4555-9b6c-4390-aaeb-97dc1443df78 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:18 devstack sudo[113539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-566c4555-9b6c-4390-aaeb-97dc1443df78 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 Jun 19 04:32:18 devstack sudo[113539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:19 devstack sudo[113539]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-566c4555-9b6c-4390-aaeb-97dc1443df78 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6" returned: 0 in 0.742s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:19 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 is being set with open permissions: ugo+rw Jun 19 04:32:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:19 devstack sudo[113544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 Jun 19 04:32:19 devstack sudo[113544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (9bc66ac3-4d06-4c8c-8b97-070e4a51d5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42a2ed5-390b-4756-8d41-915adec8f170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b42a2ed5-390b-4756-8d41-915adec8f170) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2062076054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1a5c23-46c2-4ee9-86f6-a39966e64219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:20Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ffa5d7-69fc-44e0-9a50-c1ead84ae4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4ffa5d7-69fc-44e0-9a50-c1ead84ae4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5e1f64-725f-4991-9930-d53dc8247ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d5e1f64-725f-4991-9930-d53dc8247ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb1a5c23-46c2-4ee9-86f6-a39966e64219', 'volume_name': 'volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923015ba-a15b-43b2-bfa8-7242a1c62f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (923015ba-a15b-43b2-bfa8-7242a1c62f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364102d1-dd83-4861-bde4-88bac7558ad5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:20 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume cb1a5c23-46c2-4ee9-86f6-a39966e64219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219', 'volume_size': 1} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:20 devstack sudo[113544]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6" returned: 0 in 0.673s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:20 devstack sudo[113547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.info Jun 19 04:32:20 devstack sudo[113547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:20 devstack sudo[113547]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.info" returned: 0 in 0.616s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:20 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.info is being set with open permissions: ugo+rw Jun 19 04:32:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:20 devstack sudo[113550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.info Jun 19 04:32:20 devstack sudo[113550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:21 devstack sudo[113550]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.info" returned: 0 in 0.613s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.357s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.305s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2062076054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb1a5c23-46c2-4ee9-86f6-a39966e64219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:20Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Creating volume cb1a5c23-46c2-4ee9-86f6-a39966e64219 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:21 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:32:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:21 devstack sudo[113554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 1073741824 Jun 19 04:32:21 devstack sudo[113554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b0e644f7-f932-4b63-91b8-1e6ae4832f95 tempest-SnapshotDependencyTests-1139300417 None] Create snapshot completed successfully Jun 19 04:32:22 devstack sudo[113554]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 1073741824" returned: 0 in 0.786s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:22 devstack sudo[113559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 Jun 19 04:32:22 devstack sudo[113559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:23 devstack sudo[113559]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Flow 'volume_create_manager' (c6ab8a0d-b3ba-428c-a24b-99b0bd194fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9889be24-18e5-45ec-a2d6-f4847306ceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219" returned: 0 in 0.645s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9889be24-18e5-45ec-a2d6-f4847306ceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf68738b-45b9-49f0-b966-205edb5df661,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1fe513141a548248b01250e7ae79d0a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5a519fed-16a1-4b92-9ab8-523b0d94a1f6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:23Z,use_quota=True,user_id='f136ab988d764898875d4002159649fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf34813b-4dd7-4aeb-b5a0-68ae73598a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf34813b-4dd7-4aeb-b5a0-68ae73598a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7905949-c93c-41c9-be9a-2721d365a83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7905949-c93c-41c9-be9a-2721d365a83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf68738b-45b9-49f0-b966-205edb5df661', 'volume_name': 'volume-bf68738b-45b9-49f0-b966-205edb5df661', 'volume_size': 1, 'snapshot_id': '5a519fed-16a1-4b92-9ab8-523b0d94a1f6'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba646fba-2387-401b-8ee7-663146017b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba646fba-2387-401b-8ee7-663146017b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b214937-dcc9-4021-9da8-a3c65b26c231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:23 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Volume bf68738b-45b9-49f0-b966-205edb5df661: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf68738b-45b9-49f0-b966-205edb5df661', 'volume_size': 1, 'snapshot_id': '5a519fed-16a1-4b92-9ab8-523b0d94a1f6'} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (364102d1-dd83-4861-bde4-88bac7558ad5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc016747-ad7b-4003-9c6d-6d2a8cc157a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "cinder-quobyte-5a519fed-16a1-4b92-9ab8-523b0d94a1f6-bf68738b-45b9-49f0-b966-205edb5df661" by "_create_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:23 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 (cb1a5c23-46c2-4ee9-86f6-a39966e64219): created successfully Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc016747-ad7b-4003-9c6d-6d2a8cc157a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (9bc66ac3-4d06-4c8c-8b97-070e4a51d5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-5a519fed-16a1-4b92-9ab8-523b0d94a1f6-bf68738b-45b9-49f0-b966-205edb5df661" acquired by "_create_volume_from_snapshot" :: waited 0.035s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Creating volume bf68738b-45b9-49f0-b966-205edb5df661 from snapshot 5a519fed-16a1-4b92-9ab8-523b0d94a1f6 {{(pid=93769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "cinder-quobyte-bf68738b-45b9-49f0-b966-205edb5df661" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:23 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-49c5fe38-ba29-4979-9e9b-f3bd42459e3a tempest-CreateVolumesFromSnapshotTest-827570120 None] Created volume successfully. Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-bf68738b-45b9-49f0-b966-205edb5df661" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] snapshot: 5a519fed-16a1-4b92-9ab8-523b0d94a1f6, volume: bf68738b-45b9-49f0-b966-205edb5df661, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[60529408-5b7f-40d9-90a7-8077d39c2b3f]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:23 devstack sudo[113562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 Jun 19 04:32:23 devstack sudo[113562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:24 devstack sudo[113562]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6" returned: 0 in 0.736s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-566c4555-9b6c-4390-aaeb-97dc1443df78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:32:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:32:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:32:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fddb022c-7655-4f42-a015-2096be62a6db]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:24 devstack sudo[113567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 Jun 19 04:32:24 devstack sudo[113567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:24 devstack sudo[113567]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78" returned: 0 in 0.732s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:24 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:32:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:24 devstack sudo[113572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 Jun 19 04:32:24 devstack sudo[113572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:29 devstack sudo[113572]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661" returned: 0 in 4.358s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:29 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1fe4cf9-3c5b-44ef-b478-600f17908b30]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:29 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:29 devstack sudo[113585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 Jun 19 04:32:29 devstack sudo[113585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:30 devstack sudo[113585]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78" returned: 0 in 0.883s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78, size 1024.00 MB, duration 4.36 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:32:30 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Converted 1024.00 MB image at 234.92 MB/s Jun 19 04:32:30 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 is being set with open permissions: ugo+rw Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:30 devstack sudo[113590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 Jun 19 04:32:30 devstack sudo[113590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:30 devstack sudo[113590]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661" returned: 0 in 0.609s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-bf68738b-45b9-49f0-b966-205edb5df661" released by "_copy_volume_from_snapshot" :: held 7.455s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-5a519fed-16a1-4b92-9ab8-523b0d94a1f6-bf68738b-45b9-49f0-b966-205edb5df661" released by "_create_volume_from_snapshot" :: held 7.494s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.530s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.183s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Creating offline snapshot 68f0947f-fb00-426b-8eae-4bf7e4cc7a09 of volume cb1a5c23-46c2-4ee9-86f6-a39966e64219 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b214937-dcc9-4021-9da8-a3c65b26c231) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf68738b-45b9-49f0-b966-205edb5df661', 'volume_size': 1, 'snapshot_id': '5a519fed-16a1-4b92-9ab8-523b0d94a1f6'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95a43bd-094e-4c9d-81c5-0efa7e3af09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cee5b3b-4018-4e7d-b058-8b8d377f3ea2]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:30 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Volume volume-bf68738b-45b9-49f0-b966-205edb5df661 (bf68738b-45b9-49f0-b966-205edb5df661): created successfully Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e95a43bd-094e-4c9d-81c5-0efa7e3af09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Flow 'volume_create_manager' (c6ab8a0d-b3ba-428c-a24b-99b0bd194fa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:30 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9107396f-2a69-46af-8b31-596c50b0bfc6 tempest-SnapshotDependencyTests-1139300417 None] Created volume successfully. Jun 19 04:32:30 devstack sudo[113593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 Jun 19 04:32:30 devstack sudo[113593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:31 devstack sudo[113593]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219" returned: 0 in 0.728s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:31 devstack sudo[113598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 1G Jun 19 04:32:31 devstack sudo[113598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "cinder-5a519fed-16a1-4b92-9ab8-523b0d94a1f6-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-5a519fed-16a1-4b92-9ab8-523b0d94a1f6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "cinder-quobyte-566c4555-9b6c-4390-aaeb-97dc1443df78" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-566c4555-9b6c-4390-aaeb-97dc1443df78" acquired by "delete_snapshot" :: waited 0.014s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "cinder-quobyte-5a519fed-16a1-4b92-9ab8-523b0d94a1f6" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-5a519fed-16a1-4b92-9ab8-523b0d94a1f6" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Deleting offline snapshot 5a519fed-16a1-4b92-9ab8-523b0d94a1f6 of volume 566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] snapshot_file for this snap is: volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c5916d4-ae75-4dc5-8c91-0a348ec891ea]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:31 devstack sudo[113601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 Jun 19 04:32:31 devstack sudo[113601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:32 devstack sudo[113598]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 1G" returned: 0 in 0.751s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:32 devstack sudo[113607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 Jun 19 04:32:32 devstack sudo[113607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:32 devstack sudo[113601]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6" returned: 0 in 0.752s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-566c4555-9b6c-4390-aaeb-97dc1443df78(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:32:32 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf2d4fd-13b5-456c-9198-4bca6cbb8fac]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:32 devstack sudo[113612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 Jun 19 04:32:32 devstack sudo[113612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:32 devstack sudo[113607]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09" returned: 0 in 0.670s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:32 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 is being set with open permissions: ugo+rw Jun 19 04:32:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:32 devstack sudo[113617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 Jun 19 04:32:32 devstack sudo[113617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:33 devstack sudo[113612]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78" returned: 0 in 0.735s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:33 devstack sudo[113622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 Jun 19 04:32:33 devstack sudo[113622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:33 devstack sudo[113617]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09" returned: 0 in 0.618s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:33 devstack sudo[113625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.info Jun 19 04:32:33 devstack sudo[113625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:34 devstack sudo[113622]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6" returned: 0 in 0.740s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:34 devstack sudo[113630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6 Jun 19 04:32:34 devstack sudo[113630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:34 devstack sudo[113625]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.info" returned: 0 in 0.635s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:34 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.info is being set with open permissions: ugo+rw Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:34 devstack sudo[113633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.info Jun 19 04:32:34 devstack sudo[113633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:34 devstack sudo[113630]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78.5a519fed-16a1-4b92-9ab8-523b0d94a1f6" returned: 0 in 0.610s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-5a519fed-16a1-4b92-9ab8-523b0d94a1f6" released by "_delete_snapshot" :: held 2.929s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-566c4555-9b6c-4390-aaeb-97dc1443df78" released by "delete_snapshot" :: held 2.951s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Created reservations ['b7211af2-a331-4d66-bef5-9fb61860175f', '93db4561-30d1-4f8b-9b61-bdf8da57a76d', 'b5547947-39b4-4bf1-a44f-b49e6b105aaf', '74e8683b-19fd-4dee-97f7-9d7ddfa85658'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:34 devstack sudo[113633]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.info" returned: 0 in 0.612s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.127s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:34 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Delete snapshot completed successfully. Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a3938df-1326-4213-a419-ce75b77a37b1 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-5a519fed-16a1-4b92-9ab8-523b0d94a1f6-delete_snapshot" released by "delete_snapshot" :: held 3.113s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:34 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-636534b3-bf7d-4371-97bb-6ab400eeb645 tempest-CreateVolumesFromSnapshotTest-827570120 None] Create snapshot completed successfully Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "cinder-566c4555-9b6c-4390-aaeb-97dc1443df78-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-566c4555-9b6c-4390-aaeb-97dc1443df78-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "cinder-quobyte-566c4555-9b6c-4390-aaeb-97dc1443df78" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-566c4555-9b6c-4390-aaeb-97dc1443df78" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d42bf12-eb10-462f-b8ac-65f7ea8b9428]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:35 devstack sudo[113637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 Jun 19 04:32:35 devstack sudo[113637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (a4122418-e091-4d1a-baf2-7adaf8bf9a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245d137b-5887-46e3-95b8-42a6d85fbc6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (245d137b-5887-46e3-95b8-42a6d85fbc6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865034874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d83f55b-37f6-40e6-a705-ae97be7172fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:35Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c029f00-d481-4f10-bc4f-08923515c185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c029f00-d481-4f10-bc4f-08923515c185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2266f31-c37d-4179-a39a-507fca26d4f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2266f31-c37d-4179-a39a-507fca26d4f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d83f55b-37f6-40e6-a705-ae97be7172fe', 'volume_name': 'volume-7d83f55b-37f6-40e6-a705-ae97be7172fe', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cda0d1b-7fa6-4e4c-b297-e8cb9202e8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cda0d1b-7fa6-4e4c-b297-e8cb9202e8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c72d379-fc51-4ce8-acd8-5de8964c65f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:35 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume 7d83f55b-37f6-40e6-a705-ae97be7172fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d83f55b-37f6-40e6-a705-ae97be7172fe', 'volume_size': 1} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1865034874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d83f55b-37f6-40e6-a705-ae97be7172fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:35Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Creating volume 7d83f55b-37f6-40e6-a705-ae97be7172fe {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:35 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:35 devstack sudo[113639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe 1073741824 Jun 19 04:32:35 devstack sudo[113639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:35 devstack sudo[113637]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78" returned: 0 in 0.857s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:35 devstack sudo[113644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78 Jun 19 04:32:35 devstack sudo[113644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (b8f4a59a-de55-4c5a-a484-db759569148f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c360a74b-df27-4ca2-a257-17ba8fdc98a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c360a74b-df27-4ca2-a257-17ba8fdc98a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1718204557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529e52ba-81a2-4693-82f1-a65677abb109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:36Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c58cca-4e61-40ed-a883-e15e829c7c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7c58cca-4e61-40ed-a883-e15e829c7c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7de187-3f57-4e28-8284-1f37e43c1319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f7de187-3f57-4e28-8284-1f37e43c1319) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '529e52ba-81a2-4693-82f1-a65677abb109', 'volume_name': 'volume-529e52ba-81a2-4693-82f1-a65677abb109', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f03d12-73ca-41ea-bc57-a0251f496121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1f03d12-73ca-41ea-bc57-a0251f496121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6731138-72b6-4cb9-819b-69e94b1916ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume 529e52ba-81a2-4693-82f1-a65677abb109: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-529e52ba-81a2-4693-82f1-a65677abb109', 'volume_size': 1} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (fe6e8bf4-1d21-4a12-8e73-261969ef6821) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43d8a23-d341-42b8-a0f2-6c9d84d847c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43d8a23-d341-42b8-a0f2-6c9d84d847c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1339013477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9926073-3f51-4628-ae28-d3f247092907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:36Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3284bf-53dc-4955-9977-0f2cbdbb9704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d3284bf-53dc-4955-9977-0f2cbdbb9704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f33f60f-3872-40ab-a61f-0f4a471b0ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f33f60f-3872-40ab-a61f-0f4a471b0ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9926073-3f51-4628-ae28-d3f247092907', 'volume_name': 'volume-d9926073-3f51-4628-ae28-d3f247092907', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d749bae2-2c85-4a05-864b-b55cd661b24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d749bae2-2c85-4a05-864b-b55cd661b24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a623b108-e57a-4d9a-8a27-1321ad9a5777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume d9926073-3f51-4628-ae28-d3f247092907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9926073-3f51-4628-ae28-d3f247092907', 'volume_size': 1} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:36 devstack sudo[113644]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-566c4555-9b6c-4390-aaeb-97dc1443df78" returned: 0 in 0.824s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (d9e31e35-6d8c-42a9-83a4-11de8bb55b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d098fe21-0cf5-4151-83a0-db75e208a6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack sudo[113639]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-566c4555-9b6c-4390-aaeb-97dc1443df78" released by "delete_volume" :: held 1.781s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe 1073741824" returned: 0 in 1.146s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d098fe21-0cf5-4151-83a0-db75e208a6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143065756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc506148-5cae-4da5-ae92-3a1bb2a92915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:37Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74b3a7a-d7c9-40d5-af9f-36c7007074b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d74b3a7a-d7c9-40d5-af9f-36c7007074b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04198d8d-7123-4791-9a53-8b264147d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04198d8d-7123-4791-9a53-8b264147d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc506148-5cae-4da5-ae92-3a1bb2a92915', 'volume_name': 'volume-bc506148-5cae-4da5-ae92-3a1bb2a92915', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee194cf0-1357-43b5-833d-978fb8431231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee194cf0-1357-43b5-833d-978fb8431231) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c951261a-6172-48be-a59e-ee70113a0ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume bc506148-5cae-4da5-ae92-3a1bb2a92915: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc506148-5cae-4da5-ae92-3a1bb2a92915', 'volume_size': 1} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:36 devstack sudo[113651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe Jun 19 04:32:36 devstack sudo[113651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Created reservations ['c2b4c521-2e7c-42a4-869b-67bac96f9416', '44b67e22-b316-43c3-8049-2e28547e25bd', 'cbd699eb-4950-4047-855a-3389806be6aa', '21b0468a-08d2-4139-bdfd-44acef23957f'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:36 devstack sudo[113653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:32:36 devstack sudo[113653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (881e286d-cf09-4bd4-af69-5eb97b6162d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae85f91b-4fcf-47d4-8725-ef3b4f1a5002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae85f91b-4fcf-47d4-8725-ef3b4f1a5002) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1326799553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4c71d2-bcf5-492f-a722-cca8ac6ad617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:37Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a75265f-030a-4886-bc87-8140ae804c71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a75265f-030a-4886-bc87-8140ae804c71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b53e4c8-2bc7-4ef6-a213-cb6a24fd544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b53e4c8-2bc7-4ef6-a213-cb6a24fd544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e4c71d2-bcf5-492f-a722-cca8ac6ad617', 'volume_name': 'volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3266c762-40a7-4130-bdd2-3237a62faef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3266c762-40a7-4130-bdd2-3237a62faef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d027de-db00-4d98-a80c-1a7442e19c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:37 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume 9e4c71d2-bcf5-492f-a722-cca8ac6ad617: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617', 'volume_size': 1} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "cinder-bf68738b-45b9-49f0-b966-205edb5df661-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-bf68738b-45b9-49f0-b966-205edb5df661-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "cinder-quobyte-bf68738b-45b9-49f0-b966-205edb5df661" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-bf68738b-45b9-49f0-b966-205edb5df661" acquired by "delete_volume" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[89773420-8add-432e-a229-cf419bb9d853]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:37 devstack sudo[113655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 Jun 19 04:32:37 devstack sudo[113655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:37 devstack sudo[113651]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe" returned: 0 in 0.707s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] <== create_volume: return (1963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.966s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.541s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1718204557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=529e52ba-81a2-4693-82f1-a65677abb109,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:36Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Creating volume 529e52ba-81a2-4693-82f1-a65677abb109 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:37 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:37 devstack sudo[113659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109 1073741824 Jun 19 04:32:37 devstack sudo[113659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c72d379-fc51-4ce8-acd8-5de8964c65f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d83f55b-37f6-40e6-a705-ae97be7172fe', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7c05a3-c827-4777-adf8-cefd7e29c7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:37 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume volume-7d83f55b-37f6-40e6-a705-ae97be7172fe (7d83f55b-37f6-40e6-a705-ae97be7172fe): created successfully Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c7c05a3-c827-4777-adf8-cefd7e29c7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (a4122418-e091-4d1a-baf2-7adaf8bf9a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a9aa9a35-fd5b-48e5-ade1-43886774d2c9 tempest-CreateVolumesFromSnapshotTest-827570120 None] Created volume successfully. Jun 19 04:32:37 devstack sudo[113653]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.729s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Deleted volume successfully. Jun 19 04:32:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f2c83a03-f28a-4e92-90bd-f3af84efb381 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-566c4555-9b6c-4390-aaeb-97dc1443df78-delete_volume" released by "delete_volume" :: held 2.816s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:38 devstack sudo[113655]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661" returned: 0 in 0.858s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:38 devstack sudo[113664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661 Jun 19 04:32:38 devstack sudo[113664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:38 devstack sudo[113659]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109 1073741824" returned: 0 in 0.965s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:38 devstack sudo[113670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109 Jun 19 04:32:38 devstack sudo[113670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:38 devstack sudo[113664]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bf68738b-45b9-49f0-b966-205edb5df661" returned: 0 in 0.721s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-quobyte-bf68738b-45b9-49f0-b966-205edb5df661" released by "delete_volume" :: held 1.618s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:38 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Created reservations ['4686e556-9f4d-4266-8a59-f693d154370a', '8e6c03be-14c8-4578-84bf-37d781bb8de0', '8d8f003d-ec55-4aa1-b690-c07be1aa6b1a', 'a6914879-5f96-40a2-a44c-41c00dd09bbd'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:39 devstack sudo[113674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:32:39 devstack sudo[113674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:39 devstack sudo[113670]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109" returned: 0 in 0.738s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] <== create_volume: return (1747ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.750s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.918s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1339013477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9926073-3f51-4628-ae28-d3f247092907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:36Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Creating volume d9926073-3f51-4628-ae28-d3f247092907 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:39 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:39 devstack sudo[113677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907 1073741824 Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e6731138-72b6-4cb9-819b-69e94b1916ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-529e52ba-81a2-4693-82f1-a65677abb109', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:39 devstack sudo[113677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd888298-a33f-40da-94f7-653103c60eba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:39 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume volume-529e52ba-81a2-4693-82f1-a65677abb109 (529e52ba-81a2-4693-82f1-a65677abb109): created successfully Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd888298-a33f-40da-94f7-653103c60eba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (b8f4a59a-de55-4c5a-a484-db759569148f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:39 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f876b778-7e67-4e53-ade4-0e4a68237f7c tempest-CreateVolumesFromSnapshotTest-827570120 None] Created volume successfully. Jun 19 04:32:39 devstack sudo[113674]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.688s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:39 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Deleted volume successfully. Jun 19 04:32:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-82c04f3c-788d-4998-b486-c34273a4ef16 tempest-SnapshotDependencyTests-1139300417 None] Lock "cinder-bf68738b-45b9-49f0-b966-205edb5df661-delete_volume" released by "delete_volume" :: held 2.534s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:40 devstack sudo[113677]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907 1073741824" returned: 0 in 0.961s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:40 devstack sudo[113684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907 Jun 19 04:32:40 devstack sudo[113684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:40 devstack sudo[113684]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907" returned: 0 in 0.659s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] <== create_volume: return (1665ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.667s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.175s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-143065756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc506148-5cae-4da5-ae92-3a1bb2a92915,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:37Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Creating volume bc506148-5cae-4da5-ae92-3a1bb2a92915 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:40 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:32:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a623b108-e57a-4d9a-8a27-1321ad9a5777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9926073-3f51-4628-ae28-d3f247092907', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378b2be1-bc16-4e29-b94c-f0348715dd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:41 devstack sudo[113689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 1073741824 Jun 19 04:32:41 devstack sudo[113689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:41 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume volume-d9926073-3f51-4628-ae28-d3f247092907 (d9926073-3f51-4628-ae28-d3f247092907): created successfully Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (378b2be1-bc16-4e29-b94c-f0348715dd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (fe6e8bf4-1d21-4a12-8e73-261969ef6821) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b4796c0f-3b86-4daf-b954-0cc369906b94 tempest-CreateVolumesFromSnapshotTest-827570120 None] Created volume successfully. Jun 19 04:32:41 devstack sudo[113689]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 1073741824" returned: 0 in 0.920s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:41 devstack sudo[113695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:32:41 devstack sudo[113695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:41 devstack sudo[113697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 Jun 19 04:32:41 devstack sudo[113697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:42 devstack sudo[113697]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915" returned: 0 in 0.746s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:42 devstack sudo[113695]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] <== create_volume: return (1733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.737s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.586s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:32:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1326799553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e4c71d2-bcf5-492f-a722-cca8ac6ad617,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d08d737127e1466ebfc2d4ad6f03d177',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:32:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:32:37Z,use_quota=True,user_id='1c10c153231b41bc86c0a3135de8d801',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Creating volume 9e4c71d2-bcf5-492f-a722-cca8ac6ad617 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:32:42 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.821s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:32:42 devstack sudo[113701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 1073741824 Jun 19 04:32:42 devstack sudo[113701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c951261a-6172-48be-a59e-ee70113a0ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc506148-5cae-4da5-ae92-3a1bb2a92915', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490e5f09-cc4c-4ab7-a136-f62ad2d111da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:42 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 (bc506148-5cae-4da5-ae92-3a1bb2a92915): created successfully Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (490e5f09-cc4c-4ab7-a136-f62ad2d111da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (d9e31e35-6d8c-42a9-83a4-11de8bb55b7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:42 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-84f87e64-f340-4d74-af25-db7c4eb55508 tempest-CreateVolumesFromSnapshotTest-827570120 None] Created volume successfully. Jun 19 04:32:43 devstack sudo[113701]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 1073741824" returned: 0 in 0.979s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:43 devstack sudo[113710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 Jun 19 04:32:43 devstack sudo[113710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:44 devstack sudo[113710]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617" returned: 0 in 0.659s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8d027de-db00-4d98-a80c-1a7442e19c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad0fb8a-cd35-4b10-9a29-93dfc152511c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:32:44 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Volume volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 (9e4c71d2-bcf5-492f-a722-cca8ac6ad617): created successfully Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad0fb8a-cd35-4b10-9a29-93dfc152511c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Flow 'volume_create_manager' (881e286d-cf09-4bd4-af69-5eb97b6162d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:32:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-588d6787-3da1-4c0d-a10b-f622aaef8706 tempest-CreateVolumesFromSnapshotTest-827570120 None] Created volume successfully. Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-9e4c71d2-bcf5-492f-a722-cca8ac6ad617-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-9e4c71d2-bcf5-492f-a722-cca8ac6ad617-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-quobyte-9e4c71d2-bcf5-492f-a722-cca8ac6ad617" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-9e4c71d2-bcf5-492f-a722-cca8ac6ad617" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e34de059-aadd-46bf-b8fa-82ae5bd752ca]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:44 devstack sudo[113713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 Jun 19 04:32:44 devstack sudo[113713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:45 devstack sudo[113713]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617" returned: 0 in 0.833s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:45 devstack sudo[113719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617 Jun 19 04:32:45 devstack sudo[113719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:46 devstack sudo[113719]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9e4c71d2-bcf5-492f-a722-cca8ac6ad617" returned: 0 in 0.656s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-9e4c71d2-bcf5-492f-a722-cca8ac6ad617" released by "delete_volume" :: held 1.536s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Created reservations ['51ffa845-0166-4165-8c0f-5d5c8f7e58a6', '1469ca70-d395-499c-8490-e982744602a7', '15c8c0ba-bccc-469c-a7d1-9a59083c071f', '34ade15d-90f3-489b-b517-95ea7bd17f70'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:46 devstack sudo[113722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:32:46 devstack sudo[113722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-bc506148-5cae-4da5-ae92-3a1bb2a92915-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-bc506148-5cae-4da5-ae92-3a1bb2a92915-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-quobyte-bc506148-5cae-4da5-ae92-3a1bb2a92915" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-bc506148-5cae-4da5-ae92-3a1bb2a92915" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c55ae7d-c279-4242-9aa8-42bb0b443df7]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:47 devstack sudo[113722]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.744s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Deleted volume successfully. Jun 19 04:32:47 devstack sudo[113725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 Jun 19 04:32:47 devstack sudo[113725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa67d430-3373-481e-be98-454f41747569 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-9e4c71d2-bcf5-492f-a722-cca8ac6ad617-delete_volume" released by "delete_volume" :: held 2.511s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:47 devstack sudo[113725]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915" returned: 0 in 0.849s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:48 devstack sudo[113731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915 Jun 19 04:32:48 devstack sudo[113731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:48 devstack sudo[113731]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-bc506148-5cae-4da5-ae92-3a1bb2a92915" returned: 0 in 0.680s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-bc506148-5cae-4da5-ae92-3a1bb2a92915" released by "delete_volume" :: held 1.583s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:48 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Created reservations ['88272933-bd23-4c37-854b-8c4868a78bd1', '54664983-d17f-4d74-823f-dc1fa437628c', '370663b1-cb1a-43cc-9d7e-e473bff23a59', 'd50b658e-7d17-4e19-90e3-84dfedb78bcc'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:48 devstack sudo[113734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:32:48 devstack sudo[113734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-d9926073-3f51-4628-ae28-d3f247092907-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-d9926073-3f51-4628-ae28-d3f247092907-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-quobyte-d9926073-3f51-4628-ae28-d3f247092907" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-d9926073-3f51-4628-ae28-d3f247092907" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:49 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c285803a-6921-4c0c-9b5f-c4da25b6dd17]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:49 devstack sudo[113734]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.740s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:49 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:49 devstack sudo[113737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907 Jun 19 04:32:49 devstack sudo[113737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:49 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Deleted volume successfully. Jun 19 04:32:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c12dec0f-54cf-4cbd-b184-ea42229158ba tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-bc506148-5cae-4da5-ae92-3a1bb2a92915-delete_volume" released by "delete_volume" :: held 2.568s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:50 devstack sudo[113737]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907" returned: 0 in 0.753s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:50 devstack sudo[113743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907 Jun 19 04:32:50 devstack sudo[113743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:50 devstack sudo[113743]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d9926073-3f51-4628-ae28-d3f247092907" returned: 0 in 0.624s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-d9926073-3f51-4628-ae28-d3f247092907" released by "delete_volume" :: held 1.418s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Created reservations ['8331ae05-30c0-4cc6-af4f-a8e48b2c30d4', '5fe60f7d-fb77-4d71-9518-175c2a2e2456', '87bf255e-c708-4807-b0b2-49e3a0336c71', '86a52451-c832-41da-a5c7-0dd2e466bfcc'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:50 devstack sudo[113746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:32:50 devstack sudo[113746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-529e52ba-81a2-4693-82f1-a65677abb109-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:51 devstack sudo[113746]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-529e52ba-81a2-4693-82f1-a65677abb109-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.632s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:51 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Deleted volume successfully. Jun 19 04:32:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a84be3c-f65d-45e3-81b6-24562f5bc192 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-d9926073-3f51-4628-ae28-d3f247092907-delete_volume" released by "delete_volume" :: held 2.280s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-quobyte-529e52ba-81a2-4693-82f1-a65677abb109" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-529e52ba-81a2-4693-82f1-a65677abb109" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:51 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[04dc0557-18d2-4cdc-9f2f-def8a3210759]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:51 devstack sudo[113750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109 Jun 19 04:32:51 devstack sudo[113750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:52 devstack sudo[113750]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109" returned: 0 in 0.716s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:52 devstack sudo[113755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109 Jun 19 04:32:52 devstack sudo[113755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:52 devstack sudo[113755]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-529e52ba-81a2-4693-82f1-a65677abb109" returned: 0 in 0.641s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-529e52ba-81a2-4693-82f1-a65677abb109" released by "delete_volume" :: held 1.393s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Created reservations ['622d5243-67de-4651-9a80-d0c5623f40d0', '5f28fd9a-6acf-4773-b3eb-34a15343e0e3', 'd324c71f-0e17-4b65-b173-2781398b56ba', 'ddd529c3-bef4-4958-9f13-27539e4d454c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:53 devstack sudo[113758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:32:53 devstack sudo[113758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-7d83f55b-37f6-40e6-a705-ae97be7172fe-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:53 devstack sudo[113758]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.642s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-7d83f55b-37f6-40e6-a705-ae97be7172fe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:53 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Deleted volume successfully. Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-50ebcfe2-b940-4333-ae5f-0bc4e65c9c1d tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-529e52ba-81a2-4693-82f1-a65677abb109-delete_volume" released by "delete_volume" :: held 2.255s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-quobyte-7d83f55b-37f6-40e6-a705-ae97be7172fe" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-7d83f55b-37f6-40e6-a705-ae97be7172fe" acquired by "delete_volume" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b596d32d-6cc9-4a7a-a990-d542cc89c97a]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:53 devstack sudo[113761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe Jun 19 04:32:53 devstack sudo[113761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:54 devstack sudo[113761]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe" returned: 0 in 0.725s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:54 devstack sudo[113766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe Jun 19 04:32:54 devstack sudo[113766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:55 devstack sudo[113766]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-7d83f55b-37f6-40e6-a705-ae97be7172fe" returned: 0 in 0.617s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-7d83f55b-37f6-40e6-a705-ae97be7172fe" released by "delete_volume" :: held 1.376s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Created reservations ['46d03d72-0be8-4a9f-9d57-8acd6efc4b5d', '07c18533-f368-4051-ac1c-74963399a0ed', 'd43bbd2b-d75e-46e9-9629-9575509803cd', '2676beb3-fe2a-4d5d-8f44-cd2ad5521ca0'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:55 devstack sudo[113775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:32:55 devstack sudo[113775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:55 devstack sudo[113775]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.616s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:32:55 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Deleted volume successfully. Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-e99ee0ca-65a0-4583-90d4-913ad09140c0 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-7d83f55b-37f6-40e6-a705-ae97be7172fe-delete_volume" released by "delete_volume" :: held 2.187s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-68f0947f-fb00-426b-8eae-4bf7e4cc7a09-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-68f0947f-fb00-426b-8eae-4bf7e4cc7a09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-quobyte-cb1a5c23-46c2-4ee9-86f6-a39966e64219" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-cb1a5c23-46c2-4ee9-86f6-a39966e64219" acquired by "delete_snapshot" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-quobyte-68f0947f-fb00-426b-8eae-4bf7e4cc7a09" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-68f0947f-fb00-426b-8eae-4bf7e4cc7a09" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Deleting offline snapshot 68f0947f-fb00-426b-8eae-4bf7e4cc7a09 of volume cb1a5c23-46c2-4ee9-86f6-a39966e64219 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] snapshot_file for this snap is: volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[436fcb06-0139-4faa-82d9-d5499d0fb6f3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:56 devstack sudo[113778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 Jun 19 04:32:56 devstack sudo[113778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:56 devstack sudo[113778]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09" returned: 0 in 0.727s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eb396ad-1dbb-4d84-94e0-2cefc9acfff0]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:56 devstack sudo[113783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 Jun 19 04:32:56 devstack sudo[113783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:57 devstack sudo[113783]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219" returned: 0 in 0.714s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:57 devstack sudo[113789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 Jun 19 04:32:57 devstack sudo[113789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:58 devstack sudo[113789]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09" returned: 0 in 0.693s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:58 devstack sudo[113795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09 Jun 19 04:32:58 devstack sudo[113795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:58 devstack sudo[113795]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219.68f0947f-fb00-426b-8eae-4bf7e4cc7a09" returned: 0 in 0.617s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:58 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=76,cinder:UPDATE=90,cinder:INSERT=27,cinder:DELETE=9 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:58 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=110,cinder:SELECT=80,cinder:INSERT=29,cinder:DELETE=10 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:32:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-68f0947f-fb00-426b-8eae-4bf7e4cc7a09" released by "_delete_snapshot" :: held 2.850s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-cb1a5c23-46c2-4ee9-86f6-a39966e64219" released by "delete_snapshot" :: held 2.875s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:58 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Created reservations ['6bcb4c29-b890-4be5-87c1-8c9d7655cc87', '4cf481c6-9812-47e3-b7af-12be74653b8e', 'd6e698c7-7a54-443e-86c7-f403079d90e6', 'ee834e0d-79d1-4597-9e4f-abbba0589179'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:32:59 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Delete snapshot completed successfully. Jun 19 04:32:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6848da1d-ee5c-4eb1-89bb-44b2134cb230 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-68f0947f-fb00-426b-8eae-4bf7e4cc7a09-delete_snapshot" released by "delete_snapshot" :: held 3.013s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:32:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-cb1a5c23-46c2-4ee9-86f6-a39966e64219-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-cb1a5c23-46c2-4ee9-86f6-a39966e64219-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "cinder-quobyte-cb1a5c23-46c2-4ee9-86f6-a39966e64219" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:32:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-cb1a5c23-46c2-4ee9-86f6-a39966e64219" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:32:59 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[894522f6-823e-4bee-b65f-45c0be9623db]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:32:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:32:59 devstack sudo[113799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 Jun 19 04:32:59 devstack sudo[113799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:32:59 devstack sudo[113799]: pam_unix(sudo:session): session closed for user root Jun 19 04:32:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219" returned: 0 in 0.727s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:32:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:00 devstack sudo[113804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219 Jun 19 04:33:00 devstack sudo[113804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:00 devstack sudo[113804]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cb1a5c23-46c2-4ee9-86f6-a39966e64219" returned: 0 in 0.606s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:00 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-quobyte-cb1a5c23-46c2-4ee9-86f6-a39966e64219" released by "delete_volume" :: held 1.394s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:00 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Created reservations ['51bd52d8-b546-46d2-a3b5-3d42a676755e', '6ffa3536-531b-4b5c-aa71-ed80775a2da7', '7b52845b-dc82-4fdf-a631-a1610e6abfb8', '3f4e05af-be81-4173-837e-3ac5a52324f4'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:00 devstack sudo[113807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:33:00 devstack sudo[113807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:01 devstack sudo[113807]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.620s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:01 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:01 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Deleted volume successfully. Jun 19 04:33:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-512fb3bd-6c9f-431f-832e-e0843a650d12 tempest-CreateVolumesFromSnapshotTest-827570120 None] Lock "cinder-cb1a5c23-46c2-4ee9-86f6-a39966e64219-delete_volume" released by "delete_volume" :: held 2.210s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (813d26ca-f01d-4e23-bebf-6424a2b27fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6830e93-9192-4322-98a3-72482943e197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6830e93-9192-4322-98a3-72482943e197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1999059607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed2d469-e552-4ab4-ab23-c57a31490e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:04Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b6afa0-2979-4975-b86a-0784b451ed2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07b6afa0-2979-4975-b86a-0784b451ed2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310f27f9-8ebf-46fb-baea-25fc808a202c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (310f27f9-8ebf-46fb-baea-25fc808a202c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ed2d469-e552-4ab4-ab23-c57a31490e8a', 'volume_name': 'volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6362be7b-26f8-45cb-86bf-1dba3f62fc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6362be7b-26f8-45cb-86bf-1dba3f62fc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af211565-d5f8-4efe-9766-c3e9b01e0f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:04 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume 3ed2d469-e552-4ab4-ab23-c57a31490e8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a', 'volume_size': 1} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1999059607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ed2d469-e552-4ab4-ab23-c57a31490e8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:04Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Creating volume 3ed2d469-e552-4ab4-ab23-c57a31490e8a {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:04 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:04 devstack sudo[113812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a 1073741824 Jun 19 04:33:04 devstack sudo[113812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:04 devstack sudo[113812]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a 1073741824" returned: 0 in 0.781s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:04 devstack sudo[113818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a Jun 19 04:33:04 devstack sudo[113818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:05 devstack sudo[113818]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a" returned: 0 in 0.614s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af211565-d5f8-4efe-9766-c3e9b01e0f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26690ffb-ce4e-4624-872b-b88286f54a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:05 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a (3ed2d469-e552-4ab4-ab23-c57a31490e8a): created successfully Jun 19 04:33:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26690ffb-ce4e-4624-872b-b88286f54a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (813d26ca-f01d-4e23-bebf-6424a2b27fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:05 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-45781ecd-42d5-4f45-a71d-042371717e29 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created volume successfully. Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (9478114b-d025-4988-9887-6c03ad750812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4869c36b-ca75-4162-8ff4-f17533349775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4869c36b-ca75-4162-8ff4-f17533349775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1425374326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08b1076-a393-48f7-8c75-c059db34d609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:06Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65382ca-7ad5-4476-aba5-58d7b32b2a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c65382ca-7ad5-4476-aba5-58d7b32b2a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087dbb33-74f4-4260-8dd8-b5878d7636d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (087dbb33-74f4-4260-8dd8-b5878d7636d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a08b1076-a393-48f7-8c75-c059db34d609', 'volume_name': 'volume-a08b1076-a393-48f7-8c75-c059db34d609', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779a6cf9-70b7-4850-946d-3f6a3bbeaf66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779a6cf9-70b7-4850-946d-3f6a3bbeaf66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4a6b07-3020-4428-8a3e-b2c43dcb94f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume a08b1076-a393-48f7-8c75-c059db34d609: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a08b1076-a393-48f7-8c75-c059db34d609', 'volume_size': 1} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1425374326',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a08b1076-a393-48f7-8c75-c059db34d609,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:06Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Creating volume a08b1076-a393-48f7-8c75-c059db34d609 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:06 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:06 devstack sudo[113821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609 1073741824 Jun 19 04:33:06 devstack sudo[113821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (d2f51664-92ef-40ed-bdde-3b51b583dda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e1e34f-fd94-4122-9086-73d5fb730607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47e1e34f-fd94-4122-9086-73d5fb730607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1546138543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da1c937-bdf2-450e-98c0-854df63fe2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:07Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14babb07-94db-495c-816e-adea77740536) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14babb07-94db-495c-816e-adea77740536) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061f1009-9d2b-4cb9-94c7-3f818091b9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (061f1009-9d2b-4cb9-94c7-3f818091b9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9da1c937-bdf2-450e-98c0-854df63fe2f4', 'volume_name': 'volume-9da1c937-bdf2-450e-98c0-854df63fe2f4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db5d5c2-8b9e-4e95-aff9-e03732ce1496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8db5d5c2-8b9e-4e95-aff9-e03732ce1496) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c735f8a-f0ab-40ea-bbd2-ea8e779105b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:06 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume 9da1c937-bdf2-450e-98c0-854df63fe2f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9da1c937-bdf2-450e-98c0-854df63fe2f4', 'volume_size': 1} Jun 19 04:33:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (7c692fd3-cfe1-4b9d-a523-16809256caf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f578b8c-49b7-488f-ad56-a830e89f397a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f578b8c-49b7-488f-ad56-a830e89f397a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375837307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2df9c2d-dbda-440b-be0f-d46d333b5238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:07Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011d8885-36d8-4985-9246-4f16c98380c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (011d8885-36d8-4985-9246-4f16c98380c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71f250e-c9e7-4d53-84b8-5027044c65bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c71f250e-c9e7-4d53-84b8-5027044c65bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2df9c2d-dbda-440b-be0f-d46d333b5238', 'volume_name': 'volume-c2df9c2d-dbda-440b-be0f-d46d333b5238', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bcc321-29df-4322-9aa6-b75f727bd91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0bcc321-29df-4322-9aa6-b75f727bd91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa33120-bfcf-48f1-ac0a-47aaefc35041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume c2df9c2d-dbda-440b-be0f-d46d333b5238: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2df9c2d-dbda-440b-be0f-d46d333b5238', 'volume_size': 1} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:07 devstack sudo[113821]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609 1073741824" returned: 0 in 0.940s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:07 devstack sudo[113827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609 Jun 19 04:33:07 devstack sudo[113827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (7a0ce2dd-c5c4-4308-9327-f5f8934eb729) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8580718a-74ae-484a-a981-c6a4f8faf0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8580718a-74ae-484a-a981-c6a4f8faf0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959018248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64db6da8-bd78-4f52-a80e-fb1362f11090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:08Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d72b2-8f9f-4df6-8927-d920ffc3ae84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b5d72b2-8f9f-4df6-8927-d920ffc3ae84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef8add4-6b94-444f-8ad7-1c7862e4dbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ef8add4-6b94-444f-8ad7-1c7862e4dbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64db6da8-bd78-4f52-a80e-fb1362f11090', 'volume_name': 'volume-64db6da8-bd78-4f52-a80e-fb1362f11090', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee10a1e7-de0b-436b-9b44-06a934bec710) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee10a1e7-de0b-436b-9b44-06a934bec710) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e64adb-c167-4a54-87c3-ca721e7150b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:07 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume 64db6da8-bd78-4f52-a80e-fb1362f11090: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64db6da8-bd78-4f52-a80e-fb1362f11090', 'volume_size': 1} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:07 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (00e4e34d-81ec-4059-ad2d-05ffa3fb1cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8898cc8a-394d-4744-ba37-0dc1c1e84c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8898cc8a-394d-4744-ba37-0dc1c1e84c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239467230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a4cf5e-e456-430b-9d9f-c97988dbfa49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:08Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994cef37-9a60-4b47-ad29-ce0cb09c5361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (994cef37-9a60-4b47-ad29-ce0cb09c5361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee65f81-121f-4547-9585-e391b43dd584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee65f81-121f-4547-9585-e391b43dd584) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45a4cf5e-e456-430b-9d9f-c97988dbfa49', 'volume_name': 'volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1d2633-cdbf-4a53-8d89-cba683c50f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e1d2633-cdbf-4a53-8d89-cba683c50f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597a5a4f-d9d7-4cf8-9e58-d5440dcd99c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:08 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume 45a4cf5e-e456-430b-9d9f-c97988dbfa49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49', 'volume_size': 1} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:08 devstack sudo[113827]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609" returned: 0 in 0.671s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] <== create_volume: return (1656ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.313s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1546138543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9da1c937-bdf2-450e-98c0-854df63fe2f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:07Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Creating volume 9da1c937-bdf2-450e-98c0-854df63fe2f4 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:08 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da4a6b07-3020-4428-8a3e-b2c43dcb94f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a08b1076-a393-48f7-8c75-c059db34d609', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ee2df9-ae73-4076-acde-d9f2471cf611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:08 devstack sudo[113830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 1073741824 Jun 19 04:33:08 devstack sudo[113830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:08 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume volume-a08b1076-a393-48f7-8c75-c059db34d609 (a08b1076-a393-48f7-8c75-c059db34d609): created successfully Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34ee2df9-ae73-4076-acde-d9f2471cf611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:08 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (9478114b-d025-4988-9887-6c03ad750812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:08 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-dbb66cea-ae7a-43b9-a7b0-3bae5a07b1ed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created volume successfully. Jun 19 04:33:09 devstack sudo[113830]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 1073741824" returned: 0 in 0.846s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:09 devstack sudo[113835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 Jun 19 04:33:09 devstack sudo[113835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:09 devstack sudo[113835]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4" returned: 0 in 0.652s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.440s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1375837307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2df9c2d-dbda-440b-be0f-d46d333b5238,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:07Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Creating volume c2df9c2d-dbda-440b-be0f-d46d333b5238 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:09 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:09 devstack sudo[113838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 1073741824 Jun 19 04:33:09 devstack sudo[113838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c735f8a-f0ab-40ea-bbd2-ea8e779105b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9da1c937-bdf2-450e-98c0-854df63fe2f4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91805349-ae4a-45d5-9493-8d3425218158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:09 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 (9da1c937-bdf2-450e-98c0-854df63fe2f4): created successfully Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91805349-ae4a-45d5-9493-8d3425218158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:09 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (d2f51664-92ef-40ed-bdde-3b51b583dda2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:09 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-54cfcb42-1fad-4d70-bcab-9b98ddc525d8 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created volume successfully. Jun 19 04:33:10 devstack sudo[113838]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 1073741824" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:10 devstack sudo[113843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 Jun 19 04:33:10 devstack sudo[113843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:11 devstack sudo[113843]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238" returned: 0 in 0.626s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.559s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1959018248',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64db6da8-bd78-4f52-a80e-fb1362f11090,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:08Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Creating volume 64db6da8-bd78-4f52-a80e-fb1362f11090 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:11 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa33120-bfcf-48f1-ac0a-47aaefc35041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2df9c2d-dbda-440b-be0f-d46d333b5238', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:11 devstack sudo[113846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090 1073741824 Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8364593-dd49-4f96-b4d4-29e1ed1c4330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:11 devstack sudo[113846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:11 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 (c2df9c2d-dbda-440b-be0f-d46d333b5238): created successfully Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8364593-dd49-4f96-b4d4-29e1ed1c4330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (7c692fd3-cfe1-4b9d-a523-16809256caf9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:11 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-29562222-6fa7-4a0e-804b-24a1d47cb919 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created volume successfully. Jun 19 04:33:12 devstack sudo[113846]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090 1073741824" returned: 0 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:12 devstack sudo[113853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090 Jun 19 04:33:12 devstack sudo[113853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:12 devstack sudo[113853]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090" returned: 0 in 0.626s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] <== create_volume: return (1462ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.465s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.677s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1239467230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45a4cf5e-e456-430b-9d9f-c97988dbfa49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68e090e7e7754b958807da3c3051fba5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:08Z,use_quota=True,user_id='7887e23d53ac4340a99faf3e69563dda',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Creating volume 45a4cf5e-e456-430b-9d9f-c97988dbfa49 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:12 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:12 devstack sudo[113856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 1073741824 Jun 19 04:33:12 devstack sudo[113856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9e64adb-c167-4a54-87c3-ca721e7150b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64db6da8-bd78-4f52-a80e-fb1362f11090', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5178ce02-718b-4318-92ba-60f369c66f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:12 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume volume-64db6da8-bd78-4f52-a80e-fb1362f11090 (64db6da8-bd78-4f52-a80e-fb1362f11090): created successfully Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5178ce02-718b-4318-92ba-60f369c66f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (7a0ce2dd-c5c4-4308-9327-f5f8934eb729) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:12 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-990f4a87-5214-459e-8628-74c6ba81820a tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created volume successfully. Jun 19 04:33:13 devstack sudo[113856]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 1073741824" returned: 0 in 0.817s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:13 devstack sudo[113862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 Jun 19 04:33:13 devstack sudo[113862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:14 devstack sudo[113862]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49" returned: 0 in 0.646s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (597a5a4f-d9d7-4cf8-9e58-d5440dcd99c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b17d3af-6f89-486a-acb8-6c45275b3b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:14 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Volume volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 (45a4cf5e-e456-430b-9d9f-c97988dbfa49): created successfully Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b17d3af-6f89-486a-acb8-6c45275b3b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Flow 'volume_create_manager' (00e4e34d-81ec-4059-ad2d-05ffa3fb1cf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:14 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5d8e6668-9457-45ff-87d8-08103b8fe900 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created volume successfully. Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-45a4cf5e-e456-430b-9d9f-c97988dbfa49-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-45a4cf5e-e456-430b-9d9f-c97988dbfa49-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-quobyte-45a4cf5e-e456-430b-9d9f-c97988dbfa49" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-45a4cf5e-e456-430b-9d9f-c97988dbfa49" acquired by "delete_volume" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbcb1496-643c-4b2d-9cdd-193ff15e93cc]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:14 devstack sudo[113865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 Jun 19 04:33:14 devstack sudo[113865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:15 devstack sudo[113865]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49" returned: 0 in 0.709s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:15 devstack sudo[113870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49 Jun 19 04:33:15 devstack sudo[113870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:15 devstack sudo[113870]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45a4cf5e-e456-430b-9d9f-c97988dbfa49" returned: 0 in 0.631s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:15 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-45a4cf5e-e456-430b-9d9f-c97988dbfa49" released by "delete_volume" :: held 1.375s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created reservations ['d0ab5a33-77c4-4dd2-8def-cd19a4724bd3', 'af9d6311-de95-4ea4-9e8e-d027d1146428', '38bf9ae1-d925-402d-bd7d-f7e343e2d88f', '4866a2f9-b6fc-4d55-a699-0cafc404730c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:16 devstack sudo[113909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:33:16 devstack sudo[113909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:16 devstack sudo[113909]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.657s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:16 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Deleted volume successfully. Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-64db6da8-bd78-4f52-a80e-fb1362f11090-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-510c4e68-8f8a-4346-baa3-f6d9542cbc53 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-45a4cf5e-e456-430b-9d9f-c97988dbfa49-delete_volume" released by "delete_volume" :: held 2.217s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-64db6da8-bd78-4f52-a80e-fb1362f11090-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-quobyte-64db6da8-bd78-4f52-a80e-fb1362f11090" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-64db6da8-bd78-4f52-a80e-fb1362f11090" acquired by "delete_volume" :: waited 0.015s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[feff0aa7-703a-4a2d-900c-ccc5a4b37d51]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:16 devstack sudo[113912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090 Jun 19 04:33:16 devstack sudo[113912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:17 devstack sudo[113912]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090" returned: 0 in 0.745s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:17 devstack sudo[113917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090 Jun 19 04:33:17 devstack sudo[113917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:18 devstack sudo[113917]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-64db6da8-bd78-4f52-a80e-fb1362f11090" returned: 0 in 0.658s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-64db6da8-bd78-4f52-a80e-fb1362f11090" released by "delete_volume" :: held 1.440s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created reservations ['e497f34e-a4c5-41f1-af83-3eaf4330bb39', '7eb23bf1-5731-4c1c-8891-1856ed2c95d3', '0c8219ff-98eb-458b-b003-b17b425e3edd', '3c698e5b-018a-4385-9f7a-2248191dff09'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:18 devstack sudo[113920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:33:18 devstack sudo[113920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-c2df9c2d-dbda-440b-be0f-d46d333b5238-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:18 devstack sudo[113920]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.620s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:18 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:18 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Deleted volume successfully. Jun 19 04:33:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-c2df9c2d-dbda-440b-be0f-d46d333b5238-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-0a511457-f88f-46b2-85e4-4859c5cf05b0 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-64db6da8-bd78-4f52-a80e-fb1362f11090-delete_volume" released by "delete_volume" :: held 2.244s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-quobyte-c2df9c2d-dbda-440b-be0f-d46d333b5238" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-c2df9c2d-dbda-440b-be0f-d46d333b5238" acquired by "delete_volume" :: waited 0.013s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:19 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb30c80c-bdee-46e1-a5e2-448e263c87a6]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:19 devstack sudo[113923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 Jun 19 04:33:19 devstack sudo[113923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:19 devstack sudo[113923]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238" returned: 0 in 0.748s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:19 devstack sudo[113928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238 Jun 19 04:33:19 devstack sudo[113928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:20 devstack sudo[113928]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c2df9c2d-dbda-440b-be0f-d46d333b5238" returned: 0 in 0.644s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-c2df9c2d-dbda-440b-be0f-d46d333b5238" released by "delete_volume" :: held 1.428s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:20 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created reservations ['d17f1029-2571-42f5-b1bf-5154de336eb3', '5ae6e73c-51cc-448d-a42a-362fe1bca5da', 'ca221565-ee86-49de-bee6-243d91c9b36a', 'a8941f48-60bf-47a7-ae08-58bb82dec90c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:20 devstack sudo[113931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:33:20 devstack sudo[113931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-9da1c937-bdf2-450e-98c0-854df63fe2f4-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:21 devstack sudo[113931]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.644s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:21 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-9da1c937-bdf2-450e-98c0-854df63fe2f4-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Deleted volume successfully. Jun 19 04:33:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1de37042-97bb-405b-8ac2-1a4ea1d3489d tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-c2df9c2d-dbda-440b-be0f-d46d333b5238-delete_volume" released by "delete_volume" :: held 2.279s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-quobyte-9da1c937-bdf2-450e-98c0-854df63fe2f4" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-9da1c937-bdf2-450e-98c0-854df63fe2f4" acquired by "delete_volume" :: waited 0.014s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e44c45-ebc8-4cd2-8794-0576243054aa]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:21 devstack sudo[113934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 Jun 19 04:33:21 devstack sudo[113934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:22 devstack sudo[113934]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4" returned: 0 in 0.742s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:22 devstack sudo[113940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4 Jun 19 04:33:22 devstack sudo[113940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:22 devstack sudo[113940]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9da1c937-bdf2-450e-98c0-854df63fe2f4" returned: 0 in 0.637s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-9da1c937-bdf2-450e-98c0-854df63fe2f4" released by "delete_volume" :: held 1.420s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created reservations ['2c72a982-e02f-4899-b2c6-5daa103bcce6', 'd0cf7717-20e7-4e9a-951f-5544f79afa25', 'aa6e1761-fe6e-42b6-9a08-41741d98395c', '145280ee-0f69-400a-a5c9-dbc9eefd254e'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:22 devstack sudo[113943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:33:22 devstack sudo[113943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-a08b1076-a393-48f7-8c75-c059db34d609-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:23 devstack sudo[113943]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-a08b1076-a393-48f7-8c75-c059db34d609-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.624s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:23 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:23 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Deleted volume successfully. Jun 19 04:33:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-quobyte-a08b1076-a393-48f7-8c75-c059db34d609" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-24a64aa4-ebc2-4620-af39-67f4d8e57aed tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-9da1c937-bdf2-450e-98c0-854df63fe2f4-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-a08b1076-a393-48f7-8c75-c059db34d609" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:23 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ff2c67-d399-4372-af4c-8502df09209b]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:23 devstack sudo[113946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609 Jun 19 04:33:23 devstack sudo[113946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:24 devstack sudo[113946]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609" returned: 0 in 0.739s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:24 devstack sudo[113951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609 Jun 19 04:33:24 devstack sudo[113951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:24 devstack sudo[113951]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-a08b1076-a393-48f7-8c75-c059db34d609" returned: 0 in 0.634s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-a08b1076-a393-48f7-8c75-c059db34d609" released by "delete_volume" :: held 1.410s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:24 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created reservations ['96b38116-6cd8-4eb4-a60c-396b91a2221c', '9914d124-9371-4629-9ba8-589f96b40ca5', 'e19e56f6-dee9-4eb3-8e10-835bff6334fd', '41746910-b463-4330-967d-e7fa2e70a81d'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:25 devstack sudo[113954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:33:25 devstack sudo[113954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:25 devstack sudo[113954]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-3ed2d469-e552-4ab4-ab23-c57a31490e8a-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.652s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Deleted volume successfully. Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-3ed2d469-e552-4ab4-ab23-c57a31490e8a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a93f0a58-9e8e-49e1-b15c-4c42962f67e3 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-a08b1076-a393-48f7-8c75-c059db34d609-delete_volume" released by "delete_volume" :: held 2.274s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "cinder-quobyte-3ed2d469-e552-4ab4-ab23-c57a31490e8a" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-3ed2d469-e552-4ab4-ab23-c57a31490e8a" acquired by "delete_volume" :: waited 0.014s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[47cbc076-efc7-49b4-983c-d21783e8d5ed]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:25 devstack sudo[113957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a Jun 19 04:33:25 devstack sudo[113957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:26 devstack sudo[113957]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a" returned: 0 in 0.775s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:26 devstack sudo[113962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a Jun 19 04:33:26 devstack sudo[113962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:27 devstack sudo[113962]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-3ed2d469-e552-4ab4-ab23-c57a31490e8a" returned: 0 in 0.630s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-quobyte-3ed2d469-e552-4ab4-ab23-c57a31490e8a" released by "delete_volume" :: held 1.443s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Created reservations ['5e9af45f-f07f-4296-83d9-2fe2d56d01d7', '39169880-cd48-4795-95e2-c0b1417bb37b', 'e60f1c59-12d2-4b37-97bf-98aea4b7c0c8', '031a7f01-a39b-44e0-9e0d-31903feda517'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:27 devstack sudo[113965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:33:27 devstack sudo[113965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:27 devstack sudo[113965]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.644s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:27 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Deleted volume successfully. Jun 19 04:33:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9033b3f3-a491-4208-9f1e-afcf2d5594d2 tempest-CreateVolumesFromSourceVolumeTest-1376324856 None] Lock "cinder-3ed2d469-e552-4ab4-ab23-c57a31490e8a-delete_volume" released by "delete_volume" :: held 2.284s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Flow 'volume_create_manager' (fa1f1173-6a63-4280-82bb-a969e7a11021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeaee850-4866-4863-a24c-74bc6c1d600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eeaee850-4866-4863-a24c-74bc6c1d600b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779881cf-3934-4f3b-99ba-c9cfba3567d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f7396c1b0c64999a1fbffc5bba9bf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:33Z,use_quota=True,user_id='b22fdd807acf4008866a4ed20b2a55d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637b812e-3a38-4924-8e1d-0f2bdb047441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (637b812e-3a38-4924-8e1d-0f2bdb047441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283f612-7f3c-4293-b20a-8e5005634e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.image.glance [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Creating Keystone auth plugin from conf {{(pid=93769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0283f612-7f3c-4293-b20a-8e5005634e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '779881cf-3934-4f3b-99ba-c9cfba3567d0', 'volume_name': 'volume-779881cf-3934-4f3b-99ba-c9cfba3567d0', 'volume_size': 1, 'image_id': '1cbe321f-ad51-4674-aace-bca5f097b8ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cbe321f-ad51-4674-aace-bca5f097b8ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a08e8950880c31dd8fab106d62c9076d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f7396c1b0c64999a1fbffc5bba9bf3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7654c625f3f16ee54329530a9c1940e492035be1ea232eef43cc988dc815f50931b4f1a2454fd7205c7b68e730b5fd13baddde8d3102892ce6a13df9bcae4618', 'id': '1cbe321f-ad51-4674-aace-bca5f097b8ba', 'created_at': datetime.datetime(2026, 6, 19, 2, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 33, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cbe321f-ad51-4674-aace-bca5f097b8ba/file', 'properties': {}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e788925c-b29e-4ce0-8a85-5919f6370bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:32 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e788925c-b29e-4ce0-8a85-5919f6370bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:33 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6147081-7a64-45fc-8564-ea4058097edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:33 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Volume 779881cf-3934-4f3b-99ba-c9cfba3567d0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-779881cf-3934-4f3b-99ba-c9cfba3567d0', 'volume_size': 1, 'image_id': '1cbe321f-ad51-4674-aace-bca5f097b8ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cbe321f-ad51-4674-aace-bca5f097b8ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a08e8950880c31dd8fab106d62c9076d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f7396c1b0c64999a1fbffc5bba9bf3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7654c625f3f16ee54329530a9c1940e492035be1ea232eef43cc988dc815f50931b4f1a2454fd7205c7b68e730b5fd13baddde8d3102892ce6a13df9bcae4618', 'id': '1cbe321f-ad51-4674-aace-bca5f097b8ba', 'created_at': datetime.datetime(2026, 6, 19, 2, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 33, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cbe321f-ad51-4674-aace-bca5f097b8ba/file', 'properties': {}}, 'image_service': } Jun 19 04:33:33 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Trying to clone 779881cf-3934-4f3b-99ba-c9cfba3567d0 from image 1cbe321f-ad51-4674-aace-bca5f097b8ba at location (None, [{'url': 'file:///opt/stack/data/glance/images/1cbe321f-ad51-4674-aace-bca5f097b8ba', 'metadata': {}}]). {{(pid=93769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:33:33 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:33:33 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:33:33 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb2dff6-ef76-412c-bc8d-206a1a006027]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:33 devstack sudo[113969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD Jun 19 04:33:33 devstack sudo[113969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:33 devstack sudo[113969]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD" returned: 0 in 0.709s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:33 devstack sudo[113973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD Jun 19 04:33:33 devstack sudo[113973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:34 devstack sudo[113973]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD" returned: 1 in 0.771s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:33:34 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Temporary image 1cbe321f-ad51-4674-aace-bca5f097b8ba is fetched for user b22fdd807acf4008866a4ed20b2a55d5. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:33:34 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f2c72d-dab1-46a0-a98b-a8610968c67a]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:34 devstack sudo[113978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD Jun 19 04:33:34 devstack sudo[113978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:35 devstack sudo[113978]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD" returned: 0 in 0.700s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:35 devstack sudo[113982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD Jun 19 04:33:35 devstack sudo[113982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:36 devstack sudo[113982]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD" returned: 1 in 0.689s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:33:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779881cf-3934-4f3b-99ba-c9cfba3567d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f7396c1b0c64999a1fbffc5bba9bf3a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:33:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:33:33Z,use_quota=True,user_id='b22fdd807acf4008866a4ed20b2a55d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Creating volume 779881cf-3934-4f3b-99ba-c9cfba3567d0 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:33:36 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:36 devstack sudo[113987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 1073741824 Jun 19 04:33:36 devstack sudo[113987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:36 devstack sudo[113987]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 1073741824" returned: 0 in 0.776s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:36 devstack sudo[113992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 Jun 19 04:33:36 devstack sudo[113992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:37 devstack sudo[113992]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0" returned: 0 in 0.636s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] <== create_volume: return (1459ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:33:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.462s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:37 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Attempting download of 1cbe321f-ad51-4674-aace-bca5f097b8ba ((None, [{'url': 'file:///opt/stack/data/glance/images/1cbe321f-ad51-4674-aace-bca5f097b8ba', 'metadata': {}}])) to volume 779881cf-3934-4f3b-99ba-c9cfba3567d0. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:33:37 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[29d52b40-a5cf-494d-9d30-c7beea4c99b2]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cbe321f-ad51-4674-aace-bca5f097b8ba_k_1srsv7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:37 devstack sudo[113995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cbe321f-ad51-4674-aace-bca5f097b8ba_k_1srsv7 Jun 19 04:33:37 devstack sudo[113995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:38 devstack sudo[113995]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1cbe321f-ad51-4674-aace-bca5f097b8ba_k_1srsv7" returned: 0 in 0.697s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cbe321f-ad51-4674-aace-bca5f097b8ba_k_1srsv7 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:38 devstack sudo[113999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cbe321f-ad51-4674-aace-bca5f097b8ba_k_1srsv7 Jun 19 04:33:38 devstack sudo[113999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:38 devstack sudo[113999]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cbe321f-ad51-4674-aace-bca5f097b8ba_k_1srsv7" returned: 1 in 0.684s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1cbe321f-ad51-4674-aace-bca5f097b8ba_k_1srsv7' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:33:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf54b57c-720c-461f-9360-148144a639f3]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:39 devstack sudo[114003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD Jun 19 04:33:39 devstack sudo[114003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:39 devstack sudo[114003]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD" returned: 0 in 0.795s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:39 devstack sudo[114008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD Jun 19 04:33:39 devstack sudo[114008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:40 devstack sudo[114008]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD" returned: 1 in 0.709s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:33:40 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] 1cbe321f-ad51-4674-aace-bca5f097b8ba was raw, converting to raw {{(pid=93769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:33:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:40 devstack sudo[114013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 Jun 19 04:33:40 devstack sudo[114013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:41 devstack sudo[114013]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0" returned: 0 in 0.795s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1cbe321f-ad51-4674-aace-bca5f097b8ba_m_kifu_6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:33:41 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:41 devstack sudo[114019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 1G Jun 19 04:33:41 devstack sudo[114019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:41 devstack sudo[114019]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 1G" returned: 0 in 0.652s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:41 devstack sudo[114025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:33:41 devstack sudo[114025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1409d9bb-3864-431b-92dd-816d308375a0]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:42 devstack sudo[114027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 Jun 19 04:33:42 devstack sudo[114027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:42 devstack sudo[114025]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.665s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:33:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:33:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:33:42 devstack sudo[114027]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0" returned: 0 in 0.759s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:42 devstack sudo[114032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 Jun 19 04:33:42 devstack sudo[114032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:43 devstack sudo[114032]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0" returned: 1 in 0.711s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Downloaded image 1cbe321f-ad51-4674-aace-bca5f097b8ba ((None, [{'url': 'file:///opt/stack/data/glance/images/1cbe321f-ad51-4674-aace-bca5f097b8ba', 'metadata': {}}])) to volume 779881cf-3934-4f3b-99ba-c9cfba3567d0 successfully. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Temporary image 1cbe321f-ad51-4674-aace-bca5f097b8ba for user b22fdd807acf4008866a4ed20b2a55d5 is deleted. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Marking volume 779881cf-3934-4f3b-99ba-c9cfba3567d0 as bootable. {{(pid=93769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Copying metadata from image 1cbe321f-ad51-4674-aace-bca5f097b8ba to 779881cf-3934-4f3b-99ba-c9cfba3567d0. {{(pid=93769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Creating volume glance metadata for volume 779881cf-3934-4f3b-99ba-c9cfba3567d0 backed by image 1cbe321f-ad51-4674-aace-bca5f097b8ba with: {'image_id': '1cbe321f-ad51-4674-aace-bca5f097b8ba', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a08e8950880c31dd8fab106d62c9076d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6147081-7a64-45fc-8564-ea4058097edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779881cf-3934-4f3b-99ba-c9cfba3567d0', 'volume_size': 1, 'image_id': '1cbe321f-ad51-4674-aace-bca5f097b8ba', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1cbe321f-ad51-4674-aace-bca5f097b8ba', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a08e8950880c31dd8fab106d62c9076d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '6f7396c1b0c64999a1fbffc5bba9bf3a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '7654c625f3f16ee54329530a9c1940e492035be1ea232eef43cc988dc815f50931b4f1a2454fd7205c7b68e730b5fd13baddde8d3102892ce6a13df9bcae4618', 'id': '1cbe321f-ad51-4674-aace-bca5f097b8ba', 'created_at': datetime.datetime(2026, 6, 19, 2, 33, 31, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 33, 32, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1cbe321f-ad51-4674-aace-bca5f097b8ba/file', 'properties': {}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815d1831-ef47-47b7-9c33-86be9efc0429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:33:43 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Volume volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 (779881cf-3934-4f3b-99ba-c9cfba3567d0): created successfully Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (815d1831-ef47-47b7-9c33-86be9efc0429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:33:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Flow 'volume_create_manager' (fa1f1173-6a63-4280-82bb-a969e7a11021) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:33:43 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-132511b1-0a4f-471d-a5d4-87783da608f0 tempest-VolumeImageDependencyTests-2051331241 None] Created volume successfully. Jun 19 04:33:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Acquiring lock "cinder-779881cf-3934-4f3b-99ba-c9cfba3567d0-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Lock "cinder-779881cf-3934-4f3b-99ba-c9cfba3567d0-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Acquiring lock "cinder-quobyte-779881cf-3934-4f3b-99ba-c9cfba3567d0" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:33:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Lock "cinder-quobyte-779881cf-3934-4f3b-99ba-c9cfba3567d0" acquired by "delete_volume" :: waited 0.013s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:33:44 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2320c90d-e524-4802-b6da-4a35da0e7fc3]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:33:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:44 devstack sudo[114039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 Jun 19 04:33:44 devstack sudo[114039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:45 devstack sudo[114039]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0" returned: 0 in 0.726s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:45 devstack sudo[114043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 Jun 19 04:33:45 devstack sudo[114043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:45 devstack sudo[114043]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0" returned: 1 in 0.696s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:33:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:45 devstack sudo[114048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0 Jun 19 04:33:45 devstack sudo[114048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:46 devstack sudo[114048]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-779881cf-3934-4f3b-99ba-c9cfba3567d0" returned: 0 in 0.608s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Lock "cinder-quobyte-779881cf-3934-4f3b-99ba-c9cfba3567d0" released by "delete_volume" :: held 2.091s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:46 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Created reservations ['a3b9ad03-3901-4911-9c26-d6768692464a', '00799e6e-a2f1-4b2d-8e16-96d224704cc3', 'a0ffba2a-c9cd-444c-a2ca-8d5acf2511fe', '367b3593-1a75-47d0-b235-7a7c8735c367'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:33:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:33:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:33:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:33:46 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:33:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:33:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:33:46 devstack sudo[114051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:33:46 devstack sudo[114051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:33:47 devstack sudo[114051]: pam_unix(sudo:session): session closed for user root Jun 19 04:33:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.619s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:33:47 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:33:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Deleted volume successfully. Jun 19 04:33:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-8e535c07-5f1a-426c-b2d7-4a66f31d4e8f tempest-VolumeImageDependencyTests-2051331241 None] Lock "cinder-779881cf-3934-4f3b-99ba-c9cfba3567d0-delete_volume" released by "delete_volume" :: held 2.903s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:33:56 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=57,cinder:INSERT=26,cinder:UPDATE=92,cinder:DELETE=7 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:33:57 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=72,cinder:INSERT=26,cinder:UPDATE=93,cinder:DELETE=8 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (c369878a-bba5-4f1a-b044-098d2667d9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb54876-b82b-4aba-bba8-504ba133818d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb54876-b82b-4aba-bba8-504ba133818d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1210745056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49a89f2-4f74-4727-b7a3-6ea2b27cf442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:00Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb388f8a-f562-49f1-b9a4-1ec33356fe10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb388f8a-f562-49f1-b9a4-1ec33356fe10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9799c10-a6ec-471c-a8e4-2269d3165be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9799c10-a6ec-471c-a8e4-2269d3165be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b49a89f2-4f74-4727-b7a3-6ea2b27cf442', 'volume_name': 'volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bc9451-73ec-4fdc-8aeb-282294ef44b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5bc9451-73ec-4fdc-8aeb-282294ef44b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79746bc6-72ac-4366-b1d2-9cdf05f818f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume b49a89f2-4f74-4727-b7a3-6ea2b27cf442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442', 'volume_size': 1} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1210745056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b49a89f2-4f74-4727-b7a3-6ea2b27cf442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:00Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Creating volume b49a89f2-4f74-4727-b7a3-6ea2b27cf442 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:00 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:00 devstack sudo[114101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 1073741824 Jun 19 04:34:00 devstack sudo[114101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Flow 'volume_create_manager' (60a627ca-6fbf-4d4a-a992-b2a6bb093180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71371cc-c36b-4511-bf85-d4cae9f03336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f71371cc-c36b-4511-bf85-d4cae9f03336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1583487431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e653bc2c-aaff-4f2b-b9c9-03924ee34378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fa364992ae411e9ae7f0962b20228e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:00Z,use_quota=True,user_id='f806cfea1614477fbf54cd5c5d5afa2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2952d174-25b0-413a-8be6-d82c880aa89f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2952d174-25b0-413a-8be6-d82c880aa89f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1033fbbd-79ea-49c9-990f-5bbdfea1938b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1033fbbd-79ea-49c9-990f-5bbdfea1938b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e653bc2c-aaff-4f2b-b9c9-03924ee34378', 'volume_name': 'volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdad83fd-7285-4653-a601-e17360453845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdad83fd-7285-4653-a601-e17360453845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04fd95f-f995-4aba-bd34-ca20478bd8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Volume e653bc2c-aaff-4f2b-b9c9-03924ee34378: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378', 'volume_size': 1} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Flow 'volume_create_manager' (96543a23-276e-40a7-b6ae-f6e0d5f85653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b72b3e-f443-497d-b0ad-338328b4f095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4b72b3e-f443-497d-b0ad-338328b4f095) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea41cd36-a5f9-4de5-9152-07f5bf5a4730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c5c83089744516b089d85e67cd2caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:01Z,use_quota=True,user_id='a128efda883d4da0aaf9fad1b0ec428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90f3b56-e937-4aa5-9152-e343d0ed35cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f90f3b56-e937-4aa5-9152-e343d0ed35cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a27b45-7c1d-4b3b-87e1-532d7dc953ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a27b45-7c1d-4b3b-87e1-532d7dc953ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea41cd36-a5f9-4de5-9152-07f5bf5a4730', 'volume_name': 'volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9f58cf-26d2-4150-85d1-1f4c49f2cd69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b9f58cf-26d2-4150-85d1-1f4c49f2cd69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce61556-f568-4395-aeb9-ddb0b521b890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:00 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Volume ea41cd36-a5f9-4de5-9152-07f5bf5a4730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730', 'volume_size': 1} Jun 19 04:34:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:01 devstack sudo[114101]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 1073741824" returned: 0 in 1.017s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:01 devstack sudo[114107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 Jun 19 04:34:01 devstack sudo[114107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:01 devstack sudo[114107]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" returned: 0 in 0.655s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.726s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.458s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1583487431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e653bc2c-aaff-4f2b-b9c9-03924ee34378,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fa364992ae411e9ae7f0962b20228e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:00Z,use_quota=True,user_id='f806cfea1614477fbf54cd5c5d5afa2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Creating volume e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:01 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:01 devstack sudo[114111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 1073741824 Jun 19 04:34:01 devstack sudo[114111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79746bc6-72ac-4366-b1d2-9cdf05f818f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7f10fa-0d58-4704-9dde-db288c18ea69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:01 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 (b49a89f2-4f74-4727-b7a3-6ea2b27cf442): created successfully Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c7f10fa-0d58-4704-9dde-db288c18ea69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (c369878a-bba5-4f1a-b044-098d2667d9f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:01 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-0f6650c8-d33c-4946-85b0-c45e18339c24 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created volume successfully. Jun 19 04:34:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:02 devstack sudo[114111]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 1073741824" returned: 0 in 0.923s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:02 devstack sudo[114117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 Jun 19 04:34:02 devstack sudo[114117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:03 devstack sudo[114117]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378" returned: 0 in 0.663s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] <== create_volume: return (1630ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.650s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea41cd36-a5f9-4de5-9152-07f5bf5a4730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c5c83089744516b089d85e67cd2caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:01Z,use_quota=True,user_id='a128efda883d4da0aaf9fad1b0ec428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Creating volume ea41cd36-a5f9-4de5-9152-07f5bf5a4730 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:03 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b04fd95f-f995-4aba-bd34-ca20478bd8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d171ade-bf21-4ad2-b3c5-7c2771bd829d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:03 devstack sudo[114120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 1073741824 Jun 19 04:34:03 devstack sudo[114120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:03 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Volume volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 (e653bc2c-aaff-4f2b-b9c9-03924ee34378): created successfully Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d171ade-bf21-4ad2-b3c5-7c2771bd829d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Flow 'volume_create_manager' (60a627ca-6fbf-4d4a-a992-b2a6bb093180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:03 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-371cb7e6-3aca-44ee-bfc9-83158b0d3204 tempest-VolumeDependencyTests-722052457 None] Created volume successfully. Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Flow 'volume_create_manager' (885db7b9-8c4b-4263-9418-e63a9b18255c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77a2a92-314f-4e0f-bc5e-437184c6190c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f77a2a92-314f-4e0f-bc5e-437184c6190c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b916f3-6471-4d32-91cf-28f93aba9981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34704ecd036414fb16647430346e93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:04Z,use_quota=True,user_id='3d96c95fbe424d9b8e3d2da3d28e3aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8f1d99e-7475-4d17-8b0c-9649cf0eaf24),volume_type_id=e8f1d99e-7475-4d17-8b0c-9649cf0eaf24)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75d0f88-e4f2-4314-8ccf-c533aebe44d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f75d0f88-e4f2-4314-8ccf-c533aebe44d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2ade86-ac3d-4687-94ef-1441f84426c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:03 devstack cinder-volume[93769]: DEBUG cinder.image.glance [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Creating Keystone auth plugin from conf {{(pid=93769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ee2ade86-ac3d-4687-94ef-1441f84426c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b3b916f3-6471-4d32-91cf-28f93aba9981', 'volume_name': 'volume-b3b916f3-6471-4d32-91cf-28f93aba9981', 'volume_size': 1, 'image_id': '7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e8e2abe90ead6926fcf026297b100d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a34704ecd036414fb16647430346e93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14b0d3ad0406eff79e63665c9566a4c3d5e03d47161aa66f58472d946bf295c5ed67bd8b60efc499ffe3f0df75e23b57ec474f4c7690323d937dbde13890c08a', 'id': '7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'created_at': datetime.datetime(2026, 6, 19, 2, 34, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bdc3b82-0f7e-4a22-9d63-b30885930ba3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1699944f-e973-4543-9c22-92e2cdaa251c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1699944f-e973-4543-9c22-92e2cdaa251c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649124c1-3c27-4d33-beb1-eaf38db93cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:04 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Volume b3b916f3-6471-4d32-91cf-28f93aba9981: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b3b916f3-6471-4d32-91cf-28f93aba9981', 'volume_size': 1, 'image_id': '7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e8e2abe90ead6926fcf026297b100d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a34704ecd036414fb16647430346e93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14b0d3ad0406eff79e63665c9566a4c3d5e03d47161aa66f58472d946bf295c5ed67bd8b60efc499ffe3f0df75e23b57ec474f4c7690323d937dbde13890c08a', 'id': '7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'created_at': datetime.datetime(2026, 6, 19, 2, 34, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bdc3b82-0f7e-4a22-9d63-b30885930ba3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Trying to clone b3b916f3-6471-4d32-91cf-28f93aba9981 from image 7bdc3b82-0f7e-4a22-9d63-b30885930ba3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'metadata': {}}]). {{(pid=93769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:34:04 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe42246-6a45-427e-8837-ead68617806a]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:04 devstack sudo[114126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD Jun 19 04:34:04 devstack sudo[114126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:04 devstack sudo[114120]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 1073741824" returned: 0 in 1.057s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:04 devstack sudo[114128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 Jun 19 04:34:04 devstack sudo[114128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:05 devstack sudo[114126]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD" returned: 0 in 0.738s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:05 devstack sudo[114132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD Jun 19 04:34:05 devstack sudo[114132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:05 devstack sudo[114128]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730" returned: 0 in 0.674s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] <== create_volume: return (1772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.776s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.954s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce61556-f568-4395-aeb9-ddb0b521b890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9ac30b-afb4-43f6-89d5-931e9485cb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Creating offline snapshot b5a5cf73-7b43-4c19-ae2b-58f246dfe193 of volume b49a89f2-4f74-4727-b7a3-6ea2b27cf442 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:34:05 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Volume volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 (ea41cd36-a5f9-4de5-9152-07f5bf5a4730): created successfully Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b9ac30b-afb4-43f6-89d5-931e9485cb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Flow 'volume_create_manager' (96543a23-276e-40a7-b6ae-f6e0d5f85653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[1916addc-cdbd-4999-98da-923e13688580]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:05 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-54bb5653-5231-49dc-92bd-3ca6c3a29b7e tempest-CinderUnicodeTest-2100042702 None] Created volume successfully. Jun 19 04:34:05 devstack sudo[114135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 Jun 19 04:34:05 devstack sudo[114135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:05 devstack sudo[114132]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD" returned: 1 in 0.781s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Temporary image 7bdc3b82-0f7e-4a22-9d63-b30885930ba3 is fetched for user 3d96c95fbe424d9b8e3d2da3d28e3aa4. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6d8099-5ec9-410a-baf0-8a66135d84c0]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:06 devstack sudo[114140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD Jun 19 04:34:06 devstack sudo[114140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:06 devstack sudo[114135]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" returned: 0 in 0.811s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:06 devstack sudo[114145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 1G Jun 19 04:34:06 devstack sudo[114145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Flow 'volume_create_manager' (e34ef6c2-c662-4e7e-a81c-a0b5f91600d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bde79dc-c531-4287-b225-f2a405f7a0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bde79dc-c531-4287-b225-f2a405f7a0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1445298292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31cc111c-9514-468c-a212-c31cc64a2067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c5c83089744516b089d85e67cd2caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:07Z,use_quota=True,user_id='a128efda883d4da0aaf9fad1b0ec428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67f5f9d-1058-4ce5-b400-fab6e123af2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b67f5f9d-1058-4ce5-b400-fab6e123af2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e70459e-26a6-4242-94dc-dbc0841f3569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e70459e-26a6-4242-94dc-dbc0841f3569) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31cc111c-9514-468c-a212-c31cc64a2067', 'volume_name': 'volume-31cc111c-9514-468c-a212-c31cc64a2067', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965d779c-c13e-44f3-bcb9-64ce81f0245b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (965d779c-c13e-44f3-bcb9-64ce81f0245b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49afe0f-071a-4683-82f6-6303e5c16ba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:06 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Volume 31cc111c-9514-468c-a212-c31cc64a2067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31cc111c-9514-468c-a212-c31cc64a2067', 'volume_size': 1} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:06 devstack sudo[114140]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD" returned: 0 in 0.844s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:06 devstack sudo[114152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD Jun 19 04:34:06 devstack sudo[114152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:07 devstack sudo[114145]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 1G" returned: 0 in 0.880s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:07 devstack sudo[114154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 Jun 19 04:34:07 devstack sudo[114154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:07 devstack sudo[114152]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD" returned: 1 in 0.801s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:07 devstack sudo[114154]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193" returned: 0 in 0.696s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:07 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 is being set with open permissions: ugo+rw Jun 19 04:34:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:07 devstack sudo[114162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 Jun 19 04:34:07 devstack sudo[114162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:08 devstack sudo[114162]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193" returned: 0 in 0.650s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:08 devstack sudo[114165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.info Jun 19 04:34:08 devstack sudo[114165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:09 devstack sudo[114165]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.info" returned: 0 in 0.629s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:09 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.info is being set with open permissions: ugo+rw Jun 19 04:34:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:09 devstack sudo[114168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.info Jun 19 04:34:09 devstack sudo[114168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:09 devstack sudo[114168]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.info" returned: 0 in 0.671s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.448s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.181s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Creating offline snapshot fb3a06dc-d0be-4b01-ba81-57e5fed36bde of volume e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:34:09 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a31b4b-b47b-437f-aa87-f5efd10d0c75]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:09 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-88e67aab-f65b-4d71-a516-200f27d4f323 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Create snapshot completed successfully Jun 19 04:34:09 devstack sudo[114171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 Jun 19 04:34:09 devstack sudo[114171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:10 devstack sudo[114171]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378" returned: 0 in 0.765s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:10 devstack sudo[114176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde 1G Jun 19 04:34:10 devstack sudo[114176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (2db11f81-f505-42d5-af3f-367ffdb9b11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e61fa33-7c7a-45bb-af36-44ed09418c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e61fa33-7c7a-45bb-af36-44ed09418c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607937967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4eb59a-4326-4e8a-815d-5569f9607b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:11Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad34ff4f-0df8-4ee9-969f-4168902d179d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad34ff4f-0df8-4ee9-969f-4168902d179d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3482c407-b008-4276-9604-dd10beabfd2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3482c407-b008-4276-9604-dd10beabfd2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4eb59a-4326-4e8a-815d-5569f9607b63', 'volume_name': 'volume-6c4eb59a-4326-4e8a-815d-5569f9607b63', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d84cab-4ebb-4a5a-87ff-cc22a4291529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84d84cab-4ebb-4a5a-87ff-cc22a4291529) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4e954c-9819-45b9-8d50-7d82f31933f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume 6c4eb59a-4326-4e8a-815d-5569f9607b63: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4eb59a-4326-4e8a-815d-5569f9607b63', 'volume_size': 1} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:11 devstack sudo[114176]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde 1G" returned: 0 in 0.891s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:11 devstack sudo[114182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde Jun 19 04:34:11 devstack sudo[114182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (8d840cde-9f74-4b53-8e3c-21e8f7dcc14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405e49d4-a09f-48cb-b4f8-1f714d884188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405e49d4-a09f-48cb-b4f8-1f714d884188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828670907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bbcda1-5692-413f-bb9e-1e423c249e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:11Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9bf8e6-16c4-4053-a014-bda628dfefeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e9bf8e6-16c4-4053-a014-bda628dfefeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe8f385-f7d7-4ee5-94a5-7e2c53839a86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fe8f385-f7d7-4ee5-94a5-7e2c53839a86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd6bbcda1-5692-413f-bb9e-1e423c249e16', 'volume_name': 'volume-d6bbcda1-5692-413f-bb9e-1e423c249e16', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457c52f5-c875-460c-abb9-b5836fa61801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457c52f5-c875-460c-abb9-b5836fa61801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576b2712-36ad-4bbc-8f1a-c70ecc930253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume d6bbcda1-5692-413f-bb9e-1e423c249e16: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d6bbcda1-5692-413f-bb9e-1e423c249e16', 'volume_size': 1} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (a86fb4c0-8f64-4ee8-bb0c-ea623c19aac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b261ffc-85e0-4321-9676-5495bd83dee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b261ffc-85e0-4321-9676-5495bd83dee2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584065101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfca3677-ba03-4bf9-953c-7fed5f4d91e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:12Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e47946-93c4-49eb-9b3b-522830081a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (53e47946-93c4-49eb-9b3b-522830081a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b18019-6409-4aec-8411-188f83871b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25b18019-6409-4aec-8411-188f83871b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfca3677-ba03-4bf9-953c-7fed5f4d91e4', 'volume_name': 'volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4ab66a-dd68-408c-9093-36fe62b6cf2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c4ab66a-dd68-408c-9093-36fe62b6cf2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d84e949-f28c-433d-b9f5-6105f652c919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:11 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume cfca3677-ba03-4bf9-953c-7fed5f4d91e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4', 'volume_size': 1} Jun 19 04:34:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:12 devstack sudo[114182]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde" returned: 0 in 0.728s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:12 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde is being set with open permissions: ugo+rw Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:12 devstack sudo[114188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde Jun 19 04:34:12 devstack sudo[114188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (5086d82d-e44e-4188-957a-761436f73c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162cb278-f1c6-4303-b55f-f7cc4ccfc163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (162cb278-f1c6-4303-b55f-f7cc4ccfc163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1232275121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f40fe06-12cb-4d3e-8199-1e215f98a5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:12Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43ee896-b967-48d2-830f-c12cb9259f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d43ee896-b967-48d2-830f-c12cb9259f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac12f68-1bd0-4e8f-850e-73325bb9730f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aac12f68-1bd0-4e8f-850e-73325bb9730f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f40fe06-12cb-4d3e-8199-1e215f98a5d4', 'volume_name': 'volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8fd052-8377-48fa-ab2f-421e813d04b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f8fd052-8377-48fa-ab2f-421e813d04b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35683dca-3b4f-48a9-b893-d01b5824d52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume 9f40fe06-12cb-4d3e-8199-1e215f98a5d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4', 'volume_size': 1} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (bf370074-dfdf-477f-8d9e-ed22240dacee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cfc203-241c-41ac-bcd0-6279493c3d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22cfc203-241c-41ac-bcd0-6279493c3d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836088490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39300c06-d5cc-4550-9baa-b33d0389637e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:13Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661524cb-94b2-42c4-857b-319c672252cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (661524cb-94b2-42c4-857b-319c672252cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (babb74dc-7dc3-4a2b-b0b5-2e0562794bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (babb74dc-7dc3-4a2b-b0b5-2e0562794bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39300c06-d5cc-4550-9baa-b33d0389637e', 'volume_name': 'volume-39300c06-d5cc-4550-9baa-b33d0389637e', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4441810-119c-4304-a82a-9b761f926c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4441810-119c-4304-a82a-9b761f926c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebf97c6-ed6c-4a45-9dfd-5ae45056b45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:12 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume 39300c06-d5cc-4550-9baa-b33d0389637e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39300c06-d5cc-4550-9baa-b33d0389637e', 'volume_size': 1} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:12 devstack sudo[114188]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde" returned: 0 in 0.692s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:12 devstack sudo[114191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.info Jun 19 04:34:12 devstack sudo[114191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:13 devstack sudo[114191]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.info" returned: 0 in 0.616s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:13 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.info is being set with open permissions: ugo+rw Jun 19 04:34:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:13 devstack sudo[114194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.info Jun 19 04:34:13 devstack sudo[114194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:14 devstack sudo[114194]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.info" returned: 0 in 0.610s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.390s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.429s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:06Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1445298292',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31cc111c-9514-468c-a212-c31cc64a2067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64c5c83089744516b089d85e67cd2caf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:07Z,use_quota=True,user_id='a128efda883d4da0aaf9fad1b0ec428a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Creating volume 31cc111c-9514-468c-a212-c31cc64a2067 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:14 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:14 devstack sudo[114197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 1073741824 Jun 19 04:34:14 devstack sudo[114197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:14 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-8b0ae9ad-0f0c-41db-9e17-d11de6dc8a51 tempest-VolumeDependencyTests-722052457 None] Create snapshot completed successfully Jun 19 04:34:14 devstack sudo[114197]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 1073741824" returned: 0 in 0.768s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:14 devstack sudo[114202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 Jun 19 04:34:14 devstack sudo[114202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Flow 'volume_create_manager' (7bc0f243-ec59-418f-9388-213b34a1f09a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3192ee9d-2f69-4c18-af55-f07f8b0bcc4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:15 devstack sudo[114202]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067" returned: 0 in 0.633s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] <== create_volume: return (1445ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.448s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.983s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3b916f3-6471-4d32-91cf-28f93aba9981,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a34704ecd036414fb16647430346e93d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:04Z,use_quota=True,user_id='3d96c95fbe424d9b8e3d2da3d28e3aa4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8f1d99e-7475-4d17-8b0c-9649cf0eaf24),volume_type_id=e8f1d99e-7475-4d17-8b0c-9649cf0eaf24)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Creating volume b3b916f3-6471-4d32-91cf-28f93aba9981 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:15 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3192ee9d-2f69-4c18-af55-f07f8b0bcc4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-233429308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1693f412-13b3-4373-b40b-56908e26cae8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3fa364992ae411e9ae7f0962b20228e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=fb3a06dc-d0be-4b01-ba81-57e5fed36bde,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:15Z,use_quota=True,user_id='f806cfea1614477fbf54cd5c5d5afa2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105e17e7-4b49-4435-902e-662f5da1d375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:15 devstack sudo[114205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 1073741824 Jun 19 04:34:15 devstack sudo[114205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (105e17e7-4b49-4435-902e-662f5da1d375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9ac80f-33af-4862-89cf-ab0ce473cf3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f9ac80f-33af-4862-89cf-ab0ce473cf3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1693f412-13b3-4373-b40b-56908e26cae8', 'volume_name': 'volume-1693f412-13b3-4373-b40b-56908e26cae8', 'volume_size': 1, 'snapshot_id': 'fb3a06dc-d0be-4b01-ba81-57e5fed36bde'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c913e5-8fdb-4a5e-8d17-f79135f299ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c913e5-8fdb-4a5e-8d17-f79135f299ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835a4177-bc04-43a5-ade2-4ef222819afc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:15 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Volume 1693f412-13b3-4373-b40b-56908e26cae8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1693f412-13b3-4373-b40b-56908e26cae8', 'volume_size': 1, 'snapshot_id': 'fb3a06dc-d0be-4b01-ba81-57e5fed36bde'} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d49afe0f-071a-4683-82f6-6303e5c16ba0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31cc111c-9514-468c-a212-c31cc64a2067', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83af1216-6063-4001-af78-b4b3d046f3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:15 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Volume volume-31cc111c-9514-468c-a212-c31cc64a2067 (31cc111c-9514-468c-a212-c31cc64a2067): created successfully Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83af1216-6063-4001-af78-b4b3d046f3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:15 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Flow 'volume_create_manager' (e34ef6c2-c662-4e7e-a81c-a0b5f91600d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:15 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5d9bd4e7-9025-4aed-a425-ac89f850f63f tempest-CinderUnicodeTest-2100042702 None] Created volume successfully. Jun 19 04:34:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:16 devstack sudo[114205]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 1073741824" returned: 0 in 0.967s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:16 devstack sudo[114247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 Jun 19 04:34:16 devstack sudo[114247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:17 devstack sudo[114247]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981" returned: 0 in 0.650s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.971s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-607937967',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4eb59a-4326-4e8a-815d-5569f9607b63,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:11Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Creating volume 6c4eb59a-4326-4e8a-815d-5569f9607b63 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:17 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:17 devstack sudo[114250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 1073741824 Jun 19 04:34:17 devstack sudo[114250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Attempting download of 7bdc3b82-0f7e-4a22-9d63-b30885930ba3 ((None, [{'url': 'file:///opt/stack/data/glance/images/7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'metadata': {}}])) to volume b3b916f3-6471-4d32-91cf-28f93aba9981. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[74c75f14-12e2-441d-ac64-684e37a062d5]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_1r3h2n8x {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:17 devstack sudo[114252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_1r3h2n8x Jun 19 04:34:17 devstack sudo[114252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:18 devstack sudo[114250]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 1073741824" returned: 0 in 0.829s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:18 devstack sudo[114252]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_1r3h2n8x" returned: 0 in 0.727s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_1r3h2n8x {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:18 devstack sudo[114260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 Jun 19 04:34:18 devstack sudo[114260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:18 devstack sudo[114259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_1r3h2n8x Jun 19 04:34:18 devstack sudo[114259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:18 devstack sudo[114260]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63" returned: 0 in 0.636s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.527s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.140s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-828670907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6bbcda1-5692-413f-bb9e-1e423c249e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:11Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Creating volume d6bbcda1-5692-413f-bb9e-1e423c249e16 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:18 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:18 devstack sudo[114259]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_1r3h2n8x" returned: 1 in 0.705s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_1r3h2n8x' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[044ac052-87db-484b-ba30-6c502a63c138]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:18 devstack sudo[114266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 1073741824 Jun 19 04:34:18 devstack sudo[114266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e4e954c-9819-45b9-8d50-7d82f31933f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4eb59a-4326-4e8a-815d-5569f9607b63', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47db4647-e3f9-4823-a643-5c946eba0855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:18 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 (6c4eb59a-4326-4e8a-815d-5569f9607b63): created successfully Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47db4647-e3f9-4823-a643-5c946eba0855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:18 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (2db11f81-f505-42d5-af3f-367ffdb9b11f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:18 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3dddd79a-daed-4401-b9bc-bf1fe4f70e69 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created volume successfully. Jun 19 04:34:18 devstack sudo[114268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD Jun 19 04:34:18 devstack sudo[114268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:19 devstack sudo[114268]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD" returned: 0 in 0.751s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:19 devstack sudo[114266]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 1073741824" returned: 0 in 0.871s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:19 devstack sudo[114275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD Jun 19 04:34:19 devstack sudo[114275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:19 devstack sudo[114277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 Jun 19 04:34:19 devstack sudo[114277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:20 devstack sudo[114275]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD" returned: 1 in 0.720s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] 7bdc3b82-0f7e-4a22-9d63-b30885930ba3 was raw, converting to raw {{(pid=93769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:20 devstack sudo[114284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 Jun 19 04:34:20 devstack sudo[114284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:20 devstack sudo[114277]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16" returned: 0 in 0.640s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.373s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1584065101',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfca3677-ba03-4bf9-953c-7fed5f4d91e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:12Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Creating volume cfca3677-ba03-4bf9-953c-7fed5f4d91e4 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:20 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (576b2712-36ad-4bbc-8f1a-c70ecc930253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6bbcda1-5692-413f-bb9e-1e423c249e16', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460dda0a-aa0a-4164-8c5f-55fd537c1425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:20 devstack sudo[114286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 1073741824 Jun 19 04:34:20 devstack sudo[114286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:20 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 (d6bbcda1-5692-413f-bb9e-1e423c249e16): created successfully Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460dda0a-aa0a-4164-8c5f-55fd537c1425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (8d840cde-9f74-4b53-8e3c-21e8f7dcc14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:20 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-e7bc285c-5d93-44ca-8ca5-759e91ee4fe2 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created volume successfully. Jun 19 04:34:21 devstack sudo[114284]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981" returned: 0 in 0.733s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7bdc3b82-0f7e-4a22-9d63-b30885930ba3_dut6thjudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:34:21 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:21 devstack sudo[114295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 1G Jun 19 04:34:21 devstack sudo[114295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:21 devstack sudo[114286]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 1073741824" returned: 0 in 0.872s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:21 devstack sudo[114297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 Jun 19 04:34:21 devstack sudo[114297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:21 devstack sudo[114295]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 1G" returned: 0 in 0.663s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ee4da7-ab8d-49f6-b577-7429e1270ff0]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:21 devstack sudo[114303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 Jun 19 04:34:21 devstack sudo[114303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:21 devstack sudo[114297]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4" returned: 0 in 0.663s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.556s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1232275121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f40fe06-12cb-4d3e-8199-1e215f98a5d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:12Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Creating volume 9f40fe06-12cb-4d3e-8199-1e215f98a5d4 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:21 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:21 devstack sudo[114306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 1073741824 Jun 19 04:34:21 devstack sudo[114306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d84e949-f28c-433d-b9f5-6105f652c919) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0969c9-4cfc-4846-a837-8e6ef13db173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:21 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 (cfca3677-ba03-4bf9-953c-7fed5f4d91e4): created successfully Jun 19 04:34:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c0969c9-4cfc-4846-a837-8e6ef13db173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (a86fb4c0-8f64-4ee8-bb0c-ea623c19aac1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9b1f9129-e7a6-4c08-a4c3-d19109abc206 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created volume successfully. Jun 19 04:34:22 devstack sudo[114303]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981" returned: 0 in 0.732s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:22 devstack sudo[114310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 Jun 19 04:34:22 devstack sudo[114310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:22 devstack sudo[114306]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 1073741824" returned: 0 in 0.849s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:22 devstack sudo[114316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 Jun 19 04:34:22 devstack sudo[114316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:23 devstack sudo[114310]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981" returned: 1 in 0.735s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Downloaded image 7bdc3b82-0f7e-4a22-9d63-b30885930ba3 ((None, [{'url': 'file:///opt/stack/data/glance/images/7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'metadata': {}}])) to volume b3b916f3-6471-4d32-91cf-28f93aba9981 successfully. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Temporary image 7bdc3b82-0f7e-4a22-9d63-b30885930ba3 for user 3d96c95fbe424d9b8e3d2da3d28e3aa4 is deleted. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Marking volume b3b916f3-6471-4d32-91cf-28f93aba9981 as bootable. {{(pid=93769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Copying metadata from image 7bdc3b82-0f7e-4a22-9d63-b30885930ba3 to b3b916f3-6471-4d32-91cf-28f93aba9981. {{(pid=93769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Creating volume glance metadata for volume b3b916f3-6471-4d32-91cf-28f93aba9981 backed by image 7bdc3b82-0f7e-4a22-9d63-b30885930ba3 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '2e8e2abe90ead6926fcf026297b100d3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (649124c1-3c27-4d33-beb1-eaf38db93cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3b916f3-6471-4d32-91cf-28f93aba9981', 'volume_size': 1, 'image_id': '7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2e8e2abe90ead6926fcf026297b100d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a34704ecd036414fb16647430346e93d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '14b0d3ad0406eff79e63665c9566a4c3d5e03d47161aa66f58472d946bf295c5ed67bd8b60efc499ffe3f0df75e23b57ec474f4c7690323d937dbde13890c08a', 'id': '7bdc3b82-0f7e-4a22-9d63-b30885930ba3', 'created_at': datetime.datetime(2026, 6, 19, 2, 34, 2, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 34, 3, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7bdc3b82-0f7e-4a22-9d63-b30885930ba3/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fbcc53-558d-4339-8e24-d11ff42a1b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:23 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Volume volume-b3b916f3-6471-4d32-91cf-28f93aba9981 (b3b916f3-6471-4d32-91cf-28f93aba9981): created successfully Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fbcc53-558d-4339-8e24-d11ff42a1b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Flow 'volume_create_manager' (885db7b9-8c4b-4263-9418-e63a9b18255c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:23 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-5bc1f6f4-cde7-45a8-8194-dc8e1ebef558 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Created volume successfully. Jun 19 04:34:23 devstack sudo[114316]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4" returned: 0 in 0.673s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.575s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.795s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-836088490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39300c06-d5cc-4550-9baa-b33d0389637e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4532b3b115e24ea88268c30c963a86c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:13Z,use_quota=True,user_id='bdd904b1a45940f08d6aa1f0eec41b65',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Creating volume 39300c06-d5cc-4550-9baa-b33d0389637e {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:23 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:23 devstack sudo[114322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e 1073741824 Jun 19 04:34:23 devstack sudo[114322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35683dca-3b4f-48a9-b893-d01b5824d52a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b6db18-54fd-4f71-888e-ef95697fb098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:23 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 (9f40fe06-12cb-4d3e-8199-1e215f98a5d4): created successfully Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18b6db18-54fd-4f71-888e-ef95697fb098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (5086d82d-e44e-4188-957a-761436f73c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:23 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-47043678-0d20-4e34-9b7b-6c9a64d6bd2f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created volume successfully. Jun 19 04:34:23 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Acquiring lock "cinder-b3b916f3-6471-4d32-91cf-28f93aba9981-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "cinder-b3b916f3-6471-4d32-91cf-28f93aba9981-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Acquiring lock "cinder-quobyte-b3b916f3-6471-4d32-91cf-28f93aba9981" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "cinder-quobyte-b3b916f3-6471-4d32-91cf-28f93aba9981" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf82159-8cfc-4a0f-a003-f0879b298038]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:24 devstack sudo[114327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 Jun 19 04:34:24 devstack sudo[114327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:24 devstack sudo[114322]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e 1073741824" returned: 0 in 0.827s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:24 devstack sudo[114330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e Jun 19 04:34:24 devstack sudo[114330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:24 devstack sudo[114327]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981" returned: 0 in 0.790s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:25 devstack sudo[114334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 Jun 19 04:34:25 devstack sudo[114334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:25 devstack sudo[114330]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e" returned: 0 in 0.653s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] <== create_volume: return (1524ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 9.363s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Acquiring lock "cinder-quobyte-fb3a06dc-d0be-4b01-ba81-57e5fed36bde-1693f412-13b3-4373-b40b-56908e26cae8" by "_create_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebf97c6-ed6c-4a45-9dfd-5ae45056b45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39300c06-d5cc-4550-9baa-b33d0389637e', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18368da-c449-41a3-9382-8fb4f5ac64d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-fb3a06dc-d0be-4b01-ba81-57e5fed36bde-1693f412-13b3-4373-b40b-56908e26cae8" acquired by "_create_volume_from_snapshot" :: waited 0.078s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Creating volume 1693f412-13b3-4373-b40b-56908e26cae8 from snapshot fb3a06dc-d0be-4b01-ba81-57e5fed36bde {{(pid=93769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Acquiring lock "cinder-quobyte-1693f412-13b3-4373-b40b-56908e26cae8" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:25 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Volume volume-39300c06-d5cc-4550-9baa-b33d0389637e (39300c06-d5cc-4550-9baa-b33d0389637e): created successfully Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d18368da-c449-41a3-9382-8fb4f5ac64d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Flow 'volume_create_manager' (bf370074-dfdf-477f-8d9e-ed22240dacee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-1693f412-13b3-4373-b40b-56908e26cae8" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] snapshot: fb3a06dc-d0be-4b01-ba81-57e5fed36bde, volume: 1693f412-13b3-4373-b40b-56908e26cae8, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:34:25 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c09b5bd9-7583-4dc7-ace9-ce910bdbab32 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created volume successfully. Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f611bec-6a83-4ca0-b5b4-382f778059ac]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:25 devstack sudo[114337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde Jun 19 04:34:25 devstack sudo[114337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-39300c06-d5cc-4550-9baa-b33d0389637e-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-39300c06-d5cc-4550-9baa-b33d0389637e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-quobyte-39300c06-d5cc-4550-9baa-b33d0389637e" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-39300c06-d5cc-4550-9baa-b33d0389637e" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7061a426-3a16-4bd4-a9ae-da7413fd8963]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:25 devstack sudo[114334]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981" returned: 1 in 0.853s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:34:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:25 devstack sudo[114343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981 Jun 19 04:34:25 devstack sudo[114343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:25 devstack sudo[114342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e Jun 19 04:34:25 devstack sudo[114342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:26 devstack sudo[114337]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde" returned: 0 in 0.806s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ba7a92-f36d-48c9-8eea-ba748a68a77e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:26 devstack sudo[114349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 Jun 19 04:34:26 devstack sudo[114349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:26 devstack sudo[114343]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b3b916f3-6471-4d32-91cf-28f93aba9981" returned: 0 in 0.713s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "cinder-quobyte-b3b916f3-6471-4d32-91cf-28f93aba9981" released by "delete_volume" :: held 2.413s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Created reservations ['6af61833-fc46-4331-82c2-996d5b25cdc5', '3337695d-7094-48f5-8212-eafafd55a7b7', '07ba67d1-c689-4114-b03b-3abbbe2103a5', '99f1193b-e596-48a0-bea1-19fb71a4fff1'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:26 devstack sudo[114342]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e" returned: 0 in 0.857s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:26 devstack sudo[114355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e Jun 19 04:34:26 devstack sudo[114355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:26 devstack sudo[114356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:26 devstack sudo[114356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:26 devstack sudo[114349]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378" returned: 0 in 0.813s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:34:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:26 devstack sudo[114362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 Jun 19 04:34:26 devstack sudo[114362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:27 devstack sudo[114355]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-39300c06-d5cc-4550-9baa-b33d0389637e" returned: 0 in 0.698s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-39300c06-d5cc-4550-9baa-b33d0389637e" released by "delete_volume" :: held 1.601s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:27 devstack sudo[114356]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.739s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:27 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Deleted volume successfully. Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created reservations ['b02efff0-7279-4416-a943-2c239ce54653', '2b0abf85-604d-4984-b986-79ca42f1daa7', '5a92ddfc-65a9-4bf6-b62d-6048cd99d79b', '3610a636-eb00-41d6-b392-04d9c496a7a6'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-bb0d7b1f-66e3-46d7-a41d-83688450ca14 tempest-VolumeAndVolumeTypeFromImageTest-1454919520 None] Lock "cinder-b3b916f3-6471-4d32-91cf-28f93aba9981-delete_volume" released by "delete_volume" :: held 3.384s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:27 devstack sudo[114369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:27 devstack sudo[114369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-9f40fe06-12cb-4d3e-8199-1e215f98a5d4-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-9f40fe06-12cb-4d3e-8199-1e215f98a5d4-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-quobyte-9f40fe06-12cb-4d3e-8199-1e215f98a5d4" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-9f40fe06-12cb-4d3e-8199-1e215f98a5d4" acquired by "delete_volume" :: waited 0.044s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:28 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[4094aa8f-cb4b-4698-98f5-c4da814ac817]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:28 devstack sudo[114378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 Jun 19 04:34:28 devstack sudo[114378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:28 devstack sudo[114369]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.494s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:28 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:29 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Deleted volume successfully. Jun 19 04:34:29 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aca235ba-70e9-4394-9c9d-71331e6212a9 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-39300c06-d5cc-4550-9baa-b33d0389637e-delete_volume" released by "delete_volume" :: held 3.411s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:30 devstack sudo[114378]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4" returned: 0 in 1.984s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:30 devstack sudo[114385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4 Jun 19 04:34:30 devstack sudo[114385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:31 devstack sudo[114385]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9f40fe06-12cb-4d3e-8199-1e215f98a5d4" returned: 0 in 1.652s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:31 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-9f40fe06-12cb-4d3e-8199-1e215f98a5d4" released by "delete_volume" :: held 3.793s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:32 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created reservations ['e3ad946a-a9d8-4476-a3d0-e71d0c74fea8', 'dc9c6687-3f15-4086-bae9-ac162454dfe1', '37297216-123f-4c4b-853d-557db0c3a5e4', 'f8b07198-71e4-4823-a63b-908bcba33b46'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:32 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:32 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:32 devstack sudo[114390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:32 devstack sudo[114390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-cfca3677-ba03-4bf9-953c-7fed5f4d91e4-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-cfca3677-ba03-4bf9-953c-7fed5f4d91e4-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-quobyte-cfca3677-ba03-4bf9-953c-7fed5f4d91e4" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-cfca3677-ba03-4bf9-953c-7fed5f4d91e4" acquired by "delete_volume" :: waited 0.053s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6c1c196-dc9a-4718-a1ca-93b0046fa9d2]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:33 devstack sudo[114392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 Jun 19 04:34:33 devstack sudo[114392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:33 devstack sudo[114362]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8" returned: 0 in 6.624s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5de8d9e2-490e-434f-8583-0d4857b241e3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:33 devstack sudo[114390]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.281s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:33 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Deleted volume successfully. Jun 19 04:34:33 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-03d5d8ad-be19-4eb2-b1ec-f275792e862c tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-9f40fe06-12cb-4d3e-8199-1e215f98a5d4-delete_volume" released by "delete_volume" :: held 5.531s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:33 devstack sudo[114395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 Jun 19 04:34:33 devstack sudo[114395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:34 devstack sudo[114392]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4" returned: 0 in 0.851s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:34 devstack sudo[114400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4 Jun 19 04:34:34 devstack sudo[114400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:34 devstack sudo[114395]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378" returned: 0 in 1.078s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:34 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378, size 1024.00 MB, duration 6.63 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:34:34 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Converted 1024.00 MB image at 154.56 MB/s Jun 19 04:34:34 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 is being set with open permissions: ugo+rw Jun 19 04:34:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:34 devstack sudo[114405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 Jun 19 04:34:34 devstack sudo[114405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:34 devstack sudo[114400]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:34 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-cfca3677-ba03-4bf9-953c-7fed5f4d91e4" returned: 0 in 0.725s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:34 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-cfca3677-ba03-4bf9-953c-7fed5f4d91e4" released by "delete_volume" :: held 1.652s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:34 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created reservations ['0fd831d9-5258-4d37-af83-8447bbc805d4', '9897fd51-88da-42ef-8cc6-8606a266fbe0', '1bec0e4d-98fb-4a39-b8fc-033bc8e7f8ed', 'e328bdf7-4079-4cd0-a1ee-286992f2f7c3'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:35 devstack sudo[114408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:35 devstack sudo[114408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:35 devstack sudo[114405]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8" returned: 0 in 0.697s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-1693f412-13b3-4373-b40b-56908e26cae8" released by "_copy_volume_from_snapshot" :: held 10.122s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-fb3a06dc-d0be-4b01-ba81-57e5fed36bde-1693f412-13b3-4373-b40b-56908e26cae8" released by "_create_volume_from_snapshot" :: held 10.179s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.259s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 18.902s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Creating offline snapshot 3f41d3e9-76f3-4092-a43e-80df195f265e of volume 31cc111c-9514-468c-a212-c31cc64a2067 {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (835a4177-bc04-43a5-ade2-4ef222819afc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1693f412-13b3-4373-b40b-56908e26cae8', 'volume_size': 1, 'snapshot_id': 'fb3a06dc-d0be-4b01-ba81-57e5fed36bde'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ea630f-9170-41ef-b161-768a163e20a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd28d82b-7db1-4420-af63-eb13ee9515e4]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:35 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Volume volume-1693f412-13b3-4373-b40b-56908e26cae8 (1693f412-13b3-4373-b40b-56908e26cae8): created successfully Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55ea630f-9170-41ef-b161-768a163e20a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Flow 'volume_create_manager' (7bc0f243-ec59-418f-9388-213b34a1f09a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-d6bbcda1-5692-413f-bb9e-1e423c249e16-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:35 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d9bad9a2-e99b-4f76-aae0-acd75a2e102f tempest-VolumeDependencyTests-722052457 None] Created volume successfully. Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-d6bbcda1-5692-413f-bb9e-1e423c249e16-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-quobyte-d6bbcda1-5692-413f-bb9e-1e423c249e16" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-d6bbcda1-5692-413f-bb9e-1e423c249e16" acquired by "delete_volume" :: waited 0.042s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:35 devstack sudo[114411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 Jun 19 04:34:35 devstack sudo[114411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6edaafd-2748-4a38-a22e-ebd7712e8ae3]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:35 devstack sudo[114413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 Jun 19 04:34:35 devstack sudo[114413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (455bfca8-f7d2-40ba-b289-1a0fa7de88e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c175593-b1ac-41de-a8d1-e61c00b6d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c175593-b1ac-41de-a8d1-e61c00b6d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914496447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9607f65e-82aa-43e4-ae2d-9c8b93173c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:36Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edfff81-5051-46c6-a7db-9d7bc4242041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edfff81-5051-46c6-a7db-9d7bc4242041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fa906c-5a07-4bb1-b13b-2de9a9fe597e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1fa906c-5a07-4bb1-b13b-2de9a9fe597e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9607f65e-82aa-43e4-ae2d-9c8b93173c00', 'volume_name': 'volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199f4b3a-4e18-483e-b34f-d934c473189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (199f4b3a-4e18-483e-b34f-d934c473189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869caa74-e798-4083-8554-f9b85af18a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:35 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Volume 9607f65e-82aa-43e4-ae2d-9c8b93173c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00', 'volume_size': 1} Jun 19 04:34:35 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:36 devstack sudo[114408]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.946s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:36 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Deleted volume successfully. Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c9a5f6f1-cb73-480e-b712-8d9a348db0bb tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-cfca3677-ba03-4bf9-953c-7fed5f4d91e4-delete_volume" released by "delete_volume" :: held 2.975s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (040e50e3-e670-46c5-ae0e-d86b3b982dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f8011e-278b-4f36-bf48-ecf54f1aebe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "cinder-fb3a06dc-d0be-4b01-ba81-57e5fed36bde-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4f8011e-278b-4f36-bf48-ecf54f1aebe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-264379337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1949386a-0909-448d-9f78-75287a43f9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:36Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e96ca2b-f2cb-454a-bcfb-548d5ba0232a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e96ca2b-f2cb-454a-bcfb-548d5ba0232a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e2b943-f021-47c2-94e8-fba766da6705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51e2b943-f021-47c2-94e8-fba766da6705) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1949386a-0909-448d-9f78-75287a43f9fa', 'volume_name': 'volume-1949386a-0909-448d-9f78-75287a43f9fa', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e1f1be-a4b9-419d-a903-256ffcdfe64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90e1f1be-a4b9-419d-a903-256ffcdfe64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c634ba4a-660a-4cc3-b418-f966a5ad9f98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:36 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Volume 1949386a-0909-448d-9f78-75287a43f9fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1949386a-0909-448d-9f78-75287a43f9fa', 'volume_size': 1} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-fb3a06dc-d0be-4b01-ba81-57e5fed36bde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.074s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "cinder-quobyte-e653bc2c-aaff-4f2b-b9c9-03924ee34378" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-e653bc2c-aaff-4f2b-b9c9-03924ee34378" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "cinder-quobyte-fb3a06dc-d0be-4b01-ba81-57e5fed36bde" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:36 devstack sudo[114411]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067" returned: 0 in 1.183s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-fb3a06dc-d0be-4b01-ba81-57e5fed36bde" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Deleting offline snapshot fb3a06dc-d0be-4b01-ba81-57e5fed36bde of volume e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:34:36 devstack sudo[114419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e 1G Jun 19 04:34:36 devstack sudo[114419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] snapshot_file for this snap is: volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa90a1f9-f160-46ab-a849-bd976f21c745]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:36 devstack sudo[114413]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16" returned: 0 in 1.148s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:36 devstack sudo[114426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16 Jun 19 04:34:36 devstack sudo[114426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:36 devstack sudo[114425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde Jun 19 04:34:36 devstack sudo[114425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (0447ab68-9bee-414a-adee-5933e7443450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:36 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d761fb8e-0baa-4d45-ac7d-45b60ffc9b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d761fb8e-0baa-4d45-ac7d-45b60ffc9b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985588595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3ac124-6502-4bea-8df6-c6fd5a763f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:37Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47df3fc-b0e9-4768-b2f9-f6c619f03d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b47df3fc-b0e9-4768-b2f9-f6c619f03d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaf3961-6508-4ba0-8ab1-a2b8ea3be73a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adaf3961-6508-4ba0-8ab1-a2b8ea3be73a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3ac124-6502-4bea-8df6-c6fd5a763f92', 'volume_name': 'volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad271647-503d-40ce-86c5-402c88b6b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad271647-503d-40ce-86c5-402c88b6b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0434e7ea-3c85-4bcf-8a93-36a39f6392b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Volume ee3ac124-6502-4bea-8df6-c6fd5a763f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92', 'volume_size': 1} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (ea29eb1c-f765-42bb-8162-17046d3a72a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86bb67f-24b1-4a21-a7f1-30e03d5e106d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e86bb67f-24b1-4a21-a7f1-30e03d5e106d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752071709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e42365-d1fd-48b3-b1f2-9200c60ef658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:37Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3a21d8-b7a6-49e7-bd5b-11716775728c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd3a21d8-b7a6-49e7-bd5b-11716775728c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5ca77f-25a7-4a9e-b32a-77b39de9427d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e5ca77f-25a7-4a9e-b32a-77b39de9427d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45e42365-d1fd-48b3-b1f2-9200c60ef658', 'volume_name': 'volume-45e42365-d1fd-48b3-b1f2-9200c60ef658', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f48e4da-6696-4b91-9248-f979aae5c51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f48e4da-6696-4b91-9248-f979aae5c51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeae37a-c2a4-46f1-b29f-0e58a1693ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Volume 45e42365-d1fd-48b3-b1f2-9200c60ef658: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45e42365-d1fd-48b3-b1f2-9200c60ef658', 'volume_size': 1} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:37 devstack sudo[114419]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e 1G" returned: 0 in 1.231s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31cc111c-9514-468c-a212-c31cc64a2067 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:37 devstack sudo[114425]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:37 devstack sudo[114426]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:37 devstack sudo[114436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31cc111c-9514-468c-a212-c31cc64a2067 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e Jun 19 04:34:37 devstack sudo[114436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-d6bbcda1-5692-413f-bb9e-1e423c249e16" returned: 0 in 1.050s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde" returned: 0 in 1.201s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-d6bbcda1-5692-413f-bb9e-1e423c249e16" released by "delete_volume" :: held 2.292s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (7a0275be-6178-444d-b20f-ee8a301545b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f302b940-b239-4e30-bdc0-793832db9d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[830c0e8d-0df5-446c-86da-0aeffc91b2d2]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f302b940-b239-4e30-bdc0-793832db9d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1800079855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56337bf1-406c-4490-b6b5-d6db854c9da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:38Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a290952e-49d0-4ec7-827b-e13d4c00574c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a290952e-49d0-4ec7-827b-e13d4c00574c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7cea7b-02b4-434a-a90f-a07a80db37f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c7cea7b-02b4-434a-a90f-a07a80db37f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56337bf1-406c-4490-b6b5-d6db854c9da8', 'volume_name': 'volume-56337bf1-406c-4490-b6b5-d6db854c9da8', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b189867c-7cdc-4561-8022-516a016a35b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b189867c-7cdc-4561-8022-516a016a35b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46209d8c-1617-4dd6-893d-9c9cf1209b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:37 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Volume 56337bf1-406c-4490-b6b5-d6db854c9da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56337bf1-406c-4490-b6b5-d6db854c9da8', 'volume_size': 1} Jun 19 04:34:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created reservations ['80d23bed-6bc5-4bdd-9385-176297a14b14', '15195888-c304-4c17-8ce4-19c39dddb725', '8fcfaf6c-6832-4ef6-bbc3-021867639d94', 'dfb41712-1beb-4a70-b0ac-affc2de5ec12'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:38 devstack sudo[114438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 Jun 19 04:34:38 devstack sudo[114438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:38 devstack sudo[114440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:38 devstack sudo[114440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:38 devstack sudo[114436]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31cc111c-9514-468c-a212-c31cc64a2067 -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e" returned: 0 in 0.774s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:38 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e is being set with open permissions: ugo+rw Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:38 devstack sudo[114445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e Jun 19 04:34:38 devstack sudo[114445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:38 devstack sudo[114440]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.676s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:38 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Deleted volume successfully. Jun 19 04:34:38 devstack sudo[114438]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3170c0c9-440c-463a-8d35-e6099d24d1c0 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-d6bbcda1-5692-413f-bb9e-1e423c249e16-delete_volume" released by "delete_volume" :: held 3.311s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378" returned: 0 in 0.884s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:38 devstack sudo[114452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde Jun 19 04:34:38 devstack sudo[114452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-6c4eb59a-4326-4e8a-815d-5569f9607b63-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-6c4eb59a-4326-4e8a-815d-5569f9607b63-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-quobyte-6c4eb59a-4326-4e8a-815d-5569f9607b63" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-6c4eb59a-4326-4e8a-815d-5569f9607b63" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dc3374-ab6c-41f8-8335-f1cc4889b58c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:39 devstack sudo[114454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 Jun 19 04:34:39 devstack sudo[114454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:39 devstack sudo[114445]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e" returned: 0 in 0.752s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:39 devstack sudo[114457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.info Jun 19 04:34:39 devstack sudo[114457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:39 devstack sudo[114452]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde" returned: 0 in 0.883s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:39 devstack sudo[114462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde Jun 19 04:34:39 devstack sudo[114462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:39 devstack sudo[114454]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63" returned: 0 in 0.802s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:39 devstack sudo[114467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63 Jun 19 04:34:39 devstack sudo[114467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:40 devstack sudo[114457]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.info" returned: 0 in 0.670s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:40 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.info is being set with open permissions: ugo+rw Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:40 devstack sudo[114471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.info Jun 19 04:34:40 devstack sudo[114471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:40 devstack sudo[114462]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378.fb3a06dc-d0be-4b01-ba81-57e5fed36bde" returned: 0 in 0.726s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-fb3a06dc-d0be-4b01-ba81-57e5fed36bde" released by "_delete_snapshot" :: held 3.877s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-e653bc2c-aaff-4f2b-b9c9-03924ee34378" released by "delete_snapshot" :: held 3.924s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Created reservations ['3473724e-d932-4d66-8701-13f2efc51dcf', '37c2f027-627b-441b-8310-de624e043ea3', '840c110a-c355-4087-baed-c256f71e2c3d', '46e1fb21-5e77-4308-9411-addf9480a8ac'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Delete snapshot completed successfully. Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-3c7e446f-02a5-4863-bfb5-36c60a286ae5 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-fb3a06dc-d0be-4b01-ba81-57e5fed36bde-delete_snapshot" released by "delete_snapshot" :: held 4.083s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:40 devstack sudo[114467]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-6c4eb59a-4326-4e8a-815d-5569f9607b63" returned: 0 in 0.788s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-6c4eb59a-4326-4e8a-815d-5569f9607b63" released by "delete_volume" :: held 1.646s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:40 devstack sudo[114471]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.info" returned: 0 in 0.686s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.450s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.870s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-914496447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9607f65e-82aa-43e4-ae2d-9c8b93173c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:36Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Creating volume 9607f65e-82aa-43e4-ae2d-9c8b93173c00 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:40 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "cinder-e653bc2c-aaff-4f2b-b9c9-03924ee34378-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:40 devstack sudo[114476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 1073741824 Jun 19 04:34:40 devstack sudo[114476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:40 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ffc4c89f-e7ff-47b5-82c7-6b3f3e4a6afb tempest-CinderUnicodeTest-2100042702 None] Create snapshot completed successfully Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-e653bc2c-aaff-4f2b-b9c9-03924ee34378-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created reservations ['49acccb0-169d-4c81-b7ff-43107e32e6a6', 'd8d17ef9-1677-4470-9bb4-b4d9651dc753', '26efb643-b197-4fba-916f-fd518741d080', 'dced3117-7358-4565-b1f9-b69839b11831'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "cinder-quobyte-e653bc2c-aaff-4f2b-b9c9-03924ee34378" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-e653bc2c-aaff-4f2b-b9c9-03924ee34378" acquired by "delete_volume" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fa63f2-11c4-4e02-957a-6a6f2e9bd715]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:41 devstack sudo[114480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:41 devstack sudo[114480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:41 devstack sudo[114479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 Jun 19 04:34:41 devstack sudo[114479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-b5a5cf73-7b43-4c19-ae2b-58f246dfe193-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-b5a5cf73-7b43-4c19-ae2b-58f246dfe193-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-quobyte-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" acquired by "delete_snapshot" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-quobyte-b5a5cf73-7b43-4c19-ae2b-58f246dfe193" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-b5a5cf73-7b43-4c19-ae2b-58f246dfe193" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Deleting offline snapshot b5a5cf73-7b43-4c19-ae2b-58f246dfe193 of volume b49a89f2-4f74-4727-b7a3-6ea2b27cf442 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] snapshot_file for this snap is: volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[be3a60ff-c32c-4d06-981d-aca60d3ceb66]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:41 devstack sudo[114484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 Jun 19 04:34:41 devstack sudo[114484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "cinder-3f41d3e9-76f3-4092-a43e-80df195f265e-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:41 devstack sudo[114480]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:41 devstack sudo[114476]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.992s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 1073741824" returned: 0 in 1.218s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:42 devstack sudo[114479]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:42 devstack sudo[114494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:42 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Deleted volume successfully. Jun 19 04:34:42 devstack sudo[114494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-3f41d3e9-76f3-4092-a43e-80df195f265e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.097s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "cinder-quobyte-31cc111c-9514-468c-a212-c31cc64a2067" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378" returned: 0 in 1.055s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:42 devstack sudo[114496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378 Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-c06aba3d-9de5-4ba3-9fb5-6a5e810cb08f tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-6c4eb59a-4326-4e8a-815d-5569f9607b63-delete_volume" released by "delete_volume" :: held 3.093s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-quobyte-31cc111c-9514-468c-a212-c31cc64a2067" acquired by "delete_snapshot" :: waited 0.051s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "cinder-quobyte-3f41d3e9-76f3-4092-a43e-80df195f265e" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:42 devstack sudo[114496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-quobyte-3f41d3e9-76f3-4092-a43e-80df195f265e" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Deleting offline snapshot 3f41d3e9-76f3-4092-a43e-80df195f265e of volume 31cc111c-9514-468c-a212-c31cc64a2067 {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:34:42 devstack sudo[114498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 Jun 19 04:34:42 devstack sudo[114498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] snapshot_file for this snap is: volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[010bde54-3774-445a-9d03-0f127226337f]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:42 devstack sudo[114500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e Jun 19 04:34:42 devstack sudo[114500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:42 devstack sudo[114484]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193" returned: 0 in 1.235s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[385a7494-938d-45db-8185-c7568af22c66]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:42 devstack sudo[114494]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.817s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:34:42 devstack sudo[114496]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-e653bc2c-aaff-4f2b-b9c9-03924ee34378" returned: 0 in 0.797s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-e653bc2c-aaff-4f2b-b9c9-03924ee34378" released by "delete_volume" :: held 1.920s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:42 devstack sudo[114507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 Jun 19 04:34:42 devstack sudo[114507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Created reservations ['92e9fd57-0224-4b06-a2cf-3a068fc74efe', '4777404e-16ae-4440-bdfe-d2774d24cc1b', '23da94b0-e5ef-485f-a922-29b5bd20d8e5', 'ae1347d8-2149-4e6e-9058-805f4ae2ec0c'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:42 devstack sudo[114498]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00" returned: 0 in 0.855s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] <== create_volume: return (2176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.178s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.436s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-264379337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1949386a-0909-448d-9f78-75287a43f9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:36Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Creating volume 1949386a-0909-448d-9f78-75287a43f9fa {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:42 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (869caa74-e798-4083-8554-f9b85af18a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec609cdc-0daf-4e53-a2e0-18a23d7832f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:43 devstack sudo[114510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa 1073741824 Jun 19 04:34:43 devstack sudo[114510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:43 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Volume volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 (9607f65e-82aa-43e4-ae2d-9c8b93173c00): created successfully Jun 19 04:34:43 devstack sudo[114512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:43 devstack sudo[114512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec609cdc-0daf-4e53-a2e0-18a23d7832f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (455bfca8-f7d2-40ba-b289-1a0fa7de88e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:43 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-50f3f00c-b1e9-45bf-91c6-370d61e14554 tempest-CreateVolumesFromImageTest-691499156 None] Created volume successfully. Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "cinder-1693f412-13b3-4373-b40b-56908e26cae8-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-1693f412-13b3-4373-b40b-56908e26cae8-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "cinder-quobyte-1693f412-13b3-4373-b40b-56908e26cae8" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-1693f412-13b3-4373-b40b-56908e26cae8" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f4085b-75cc-456f-baf0-84e3719cdd26]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:43 devstack sudo[114514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 Jun 19 04:34:43 devstack sudo[114514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:43 devstack sudo[114500]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e" returned: 0 in 1.537s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31cc111c-9514-468c-a212-c31cc64a2067(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[5088baec-334a-4f81-904b-81cb62eca783]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:43 devstack sudo[114524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 Jun 19 04:34:43 devstack sudo[114524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:43 devstack sudo[114507]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" returned: 0 in 1.201s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:43 devstack sudo[114530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 Jun 19 04:34:43 devstack sudo[114530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:44 devstack sudo[114512]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.027s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Deleted volume successfully. Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-28c2366f-f11d-442c-b779-a438af6ba320 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-e653bc2c-aaff-4f2b-b9c9-03924ee34378-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:44 devstack sudo[114510]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa 1073741824" returned: 0 in 1.328s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:44 devstack sudo[114538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa Jun 19 04:34:44 devstack sudo[114538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:44 devstack sudo[114514]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8" returned: 0 in 1.117s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:44 devstack sudo[114540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8 Jun 19 04:34:44 devstack sudo[114540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:44 devstack sudo[114524]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067" returned: 0 in 1.005s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:44 devstack sudo[114550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e Jun 19 04:34:44 devstack sudo[114550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:44 devstack sudo[114530]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193" returned: 0 in 0.949s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:44 devstack sudo[114552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193 Jun 19 04:34:44 devstack sudo[114552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:45 devstack sudo[114538]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa" returned: 0 in 0.721s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.152s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.014s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1985588595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3ac124-6502-4bea-8df6-c6fd5a763f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:37Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Creating volume ee3ac124-6502-4bea-8df6-c6fd5a763f92 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:45 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c634ba4a-660a-4cc3-b418-f966a5ad9f98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1949386a-0909-448d-9f78-75287a43f9fa', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:45 devstack sudo[114556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 1073741824 Jun 19 04:34:45 devstack sudo[114556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b37c4fa-346a-47be-90d9-48aa68a3ab5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:45 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Volume volume-1949386a-0909-448d-9f78-75287a43f9fa (1949386a-0909-448d-9f78-75287a43f9fa): created successfully Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b37c4fa-346a-47be-90d9-48aa68a3ab5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (040e50e3-e670-46c5-ae0e-d86b3b982dff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:45 devstack sudo[114540]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1693f412-13b3-4373-b40b-56908e26cae8" returned: 0 in 0.792s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:45 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-623ac3b1-1a80-4aca-9223-9b777e6c6dc6 tempest-CreateVolumesFromImageTest-691499156 None] Created volume successfully. Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-quobyte-1693f412-13b3-4373-b40b-56908e26cae8" released by "delete_volume" :: held 1.974s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Created reservations ['a8964105-65fa-4aa4-b2d4-22a6e515a8ed', '87cfb2f4-0ddc-42b7-b163-00d91134a5cf', '24764417-ceed-4c0a-ad5a-1690c3011fde', '6c71e4bb-621c-4da8-acde-c8aaa6708284'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:45 devstack sudo[114558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:45 devstack sudo[114558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:45 devstack sudo[114552]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:45 devstack sudo[114550]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442.b5a5cf73-7b43-4c19-ae2b-58f246dfe193" returned: 0 in 0.870s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e" returned: 0 in 1.007s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:45 devstack sudo[114565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e Jun 19 04:34:45 devstack sudo[114565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-b5a5cf73-7b43-4c19-ae2b-58f246dfe193" released by "_delete_snapshot" :: held 4.463s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" released by "delete_snapshot" :: held 4.503s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created reservations ['712a9547-3b9b-4ce2-8cd1-22d77ff8bb8a', 'a1ec3293-d467-4d82-8c69-c2f1ff4bf897', '4b0c0414-47e4-4c5a-aaff-fea217d08a77', '403f6f0a-c3f9-4b0e-8261-7999f6cdcf2b'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Delete snapshot completed successfully. Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a6ad8e09-7f1c-4c0d-a63d-4f91b081ec96 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-b5a5cf73-7b43-4c19-ae2b-58f246dfe193-delete_snapshot" released by "delete_snapshot" :: held 4.781s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:46 devstack sudo[114558]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.826s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Deleted volume successfully. Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-179560fc-6aaf-443c-a3bc-a380f2989f90 tempest-VolumeDependencyTests-722052457 None] Lock "cinder-1693f412-13b3-4373-b40b-56908e26cae8-delete_volume" released by "delete_volume" :: held 3.142s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:46 devstack sudo[114556]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 1073741824" returned: 0 in 1.239s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:46 devstack sudo[114571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 Jun 19 04:34:46 devstack sudo[114571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-b49a89f2-4f74-4727-b7a3-6ea2b27cf442-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-b49a89f2-4f74-4727-b7a3-6ea2b27cf442-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:46 devstack sudo[114565]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067.3f41d3e9-76f3-4092-a43e-80df195f265e" returned: 0 in 1.018s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-quobyte-3f41d3e9-76f3-4092-a43e-80df195f265e" released by "_delete_snapshot" :: held 4.751s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "cinder-quobyte-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-quobyte-31cc111c-9514-468c-a212-c31cc64a2067" released by "delete_snapshot" :: held 4.812s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[247eb16e-53a8-466e-afcc-21fd8c615848]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Created reservations ['05da4fc9-4ee6-4b0e-9413-bd5ba34d5acf', '91f07348-d2b2-40a1-9889-f043a0f2092c', '81ea811c-1f82-496b-8d5f-0e8efd01406a', '0a1ea29d-1baf-49cb-880f-7300749b9f5f'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:47 devstack sudo[114574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 Jun 19 04:34:47 devstack sudo[114574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Delete snapshot completed successfully. Jun 19 04:34:47 devstack sudo[114571]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92" returned: 0 in 0.737s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] <== create_volume: return (2019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.022s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.673s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-752071709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45e42365-d1fd-48b3-b1f2-9200c60ef658,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:37Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Creating volume 45e42365-d1fd-48b3-b1f2-9200c60ef658 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:47 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aab50e36-e9a4-403d-8c94-9bf841e996ef tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-3f41d3e9-76f3-4092-a43e-80df195f265e-delete_snapshot" released by "delete_snapshot" :: held 5.136s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:47 devstack sudo[114577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 1073741824 Jun 19 04:34:47 devstack sudo[114577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0434e7ea-3c85-4bcf-8a93-36a39f6392b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749a73cf-5967-4911-b7f2-47b7d0cefe27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:47 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Volume volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 (ee3ac124-6502-4bea-8df6-c6fd5a763f92): created successfully Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (749a73cf-5967-4911-b7f2-47b7d0cefe27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (0447ab68-9bee-414a-adee-5933e7443450) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:47 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6cbe783c-04a4-4726-b03c-20a8406fb1b7 tempest-CreateVolumesFromImageTest-691499156 None] Created volume successfully. Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "cinder-31cc111c-9514-468c-a212-c31cc64a2067-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-31cc111c-9514-468c-a212-c31cc64a2067-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "cinder-quobyte-31cc111c-9514-468c-a212-c31cc64a2067" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-quobyte-31cc111c-9514-468c-a212-c31cc64a2067" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc85ba8-b47c-4ea8-92f0-a6f8270fb648]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:47 devstack sudo[114579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 Jun 19 04:34:47 devstack sudo[114579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:47 devstack sudo[114574]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" returned: 0 in 0.997s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:47 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:47 devstack sudo[114587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442 Jun 19 04:34:47 devstack sudo[114587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:48 devstack sudo[114577]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 1073741824" returned: 0 in 1.107s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:48 devstack sudo[114593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 Jun 19 04:34:48 devstack sudo[114593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:48 devstack sudo[114579]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067" returned: 0 in 0.843s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:48 devstack sudo[114595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067 Jun 19 04:34:48 devstack sudo[114595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:48 devstack sudo[114587]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" returned: 0 in 0.699s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-quobyte-b49a89f2-4f74-4727-b7a3-6ea2b27cf442" released by "delete_volume" :: held 1.779s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Created reservations ['9800a856-269c-4d9d-8253-727d548bc95a', 'e7d1c29f-2b72-4fbc-b429-f649c40d51d8', '6df841f7-3d40-46de-9da0-57fb2c3236a8', '5520a560-cb76-488c-a7b7-495a6764df16'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:48 devstack sudo[114598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:48 devstack sudo[114598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:48 devstack sudo[114593]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658" returned: 0 in 0.693s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] <== create_volume: return (1850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1800079855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56337bf1-406c-4490-b6b5-d6db854c9da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c287b9b75db42d4a1fd5d6fb251b586',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:38Z,use_quota=True,user_id='871fae3e0c0e4930a4526c8230ed01c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Creating volume 56337bf1-406c-4490-b6b5-d6db854c9da8 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:48 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:49 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0eeae37a-c2a4-46f1-b29f-0e58a1693ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45e42365-d1fd-48b3-b1f2-9200c60ef658', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:49 devstack sudo[114602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8 1073741824 Jun 19 04:34:49 devstack sudo[114602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01509513-8eb7-492d-8faa-64040d150fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:49 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Volume volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 (45e42365-d1fd-48b3-b1f2-9200c60ef658): created successfully Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01509513-8eb7-492d-8faa-64040d150fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (ea29eb1c-f765-42bb-8162-17046d3a72a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:49 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a4e512d4-60e2-46d9-a17a-71a58d9b7c09 tempest-CreateVolumesFromImageTest-691499156 None] Created volume successfully. Jun 19 04:34:49 devstack sudo[114595]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-31cc111c-9514-468c-a212-c31cc64a2067" returned: 0 in 0.736s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-quobyte-31cc111c-9514-468c-a212-c31cc64a2067" released by "delete_volume" :: held 1.680s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Created reservations ['c30d042c-b623-4a11-a773-eee51ed8ed5f', '71818825-5444-44c8-8c83-75075808a752', '5a1cc5b2-31c9-4ea7-a124-976ab8bea143', 'f9084245-4687-4510-9c1e-f955526486dd'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:49 devstack sudo[114604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:49 devstack sudo[114604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:49 devstack sudo[114598]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.746s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:49 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Deleted volume successfully. Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-77826504-6a40-4e7c-8e6a-e280841ac384 tempest-CreateVolumesFromSnapshotTest-1048789596 None] Lock "cinder-b49a89f2-4f74-4727-b7a3-6ea2b27cf442-delete_volume" released by "delete_volume" :: held 2.804s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "cinder-ea41cd36-a5f9-4de5-9152-07f5bf5a4730-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-ea41cd36-a5f9-4de5-9152-07f5bf5a4730-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "cinder-quobyte-ea41cd36-a5f9-4de5-9152-07f5bf5a4730" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-quobyte-ea41cd36-a5f9-4de5-9152-07f5bf5a4730" acquired by "delete_volume" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[f178c122-3edd-4192-bc25-32120ca6c9d4]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:49 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:49 devstack sudo[114610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 Jun 19 04:34:49 devstack sudo[114610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:50 devstack sudo[114602]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8 1073741824" returned: 0 in 1.113s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:50 devstack sudo[114614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8 Jun 19 04:34:50 devstack sudo[114604]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:50 devstack sudo[114614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.832s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:50 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:50 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Deleted volume successfully. Jun 19 04:34:50 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f3c5f6ed-70ef-4624-9cf4-a8ac1ad30e73 tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-31cc111c-9514-468c-a212-c31cc64a2067-delete_volume" released by "delete_volume" :: held 2.893s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:50 devstack sudo[114610]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730" returned: 0 in 0.930s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:50 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:50 devstack sudo[114619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730 Jun 19 04:34:50 devstack sudo[114619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:51 devstack sudo[114614]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8" returned: 0 in 0.867s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] <== create_volume: return (2046ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.051s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46209d8c-1617-4dd6-893d-9c9cf1209b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56337bf1-406c-4490-b6b5-d6db854c9da8', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7ce6be-68c0-4a85-ba7e-a423d5a917d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:51 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Volume volume-56337bf1-406c-4490-b6b5-d6db854c9da8 (56337bf1-406c-4490-b6b5-d6db854c9da8): created successfully Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c7ce6be-68c0-4a85-ba7e-a423d5a917d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Flow 'volume_create_manager' (7a0275be-6178-444d-b20f-ee8a301545b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:51 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-21a45d51-d81d-48a5-b22f-a80c0cf336fc tempest-CreateVolumesFromImageTest-691499156 None] Created volume successfully. Jun 19 04:34:51 devstack sudo[114619]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ea41cd36-a5f9-4de5-9152-07f5bf5a4730" returned: 0 in 0.671s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-quobyte-ea41cd36-a5f9-4de5-9152-07f5bf5a4730" released by "delete_volume" :: held 1.647s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Created reservations ['a6aa1e99-140b-4941-a974-4bad0dcf7fb0', 'fdc821c1-d92e-4427-aa5c-0d9f649a3c87', '76ece6b6-cfbc-4678-abac-6436af2f58b6', '0f1954bc-2c3c-4327-a7a6-54881e4ae2f1'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:51 devstack sudo[114623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:51 devstack sudo[114623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-56337bf1-406c-4490-b6b5-d6db854c9da8-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-56337bf1-406c-4490-b6b5-d6db854c9da8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-quobyte-56337bf1-406c-4490-b6b5-d6db854c9da8" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-56337bf1-406c-4490-b6b5-d6db854c9da8" acquired by "delete_volume" :: waited 0.024s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f921e46-039a-48f9-a8ec-16916ec87c6f]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:51 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:51 devstack sudo[114626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8 Jun 19 04:34:51 devstack sudo[114626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:52 devstack sudo[114623]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.750s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:52 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Deleted volume successfully. Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-6a3c556e-4b11-42c1-b90f-e09115ade8bb tempest-CinderUnicodeTest-2100042702 None] Lock "cinder-ea41cd36-a5f9-4de5-9152-07f5bf5a4730-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (a0dc99de-5f38-4e6c-b6ff-6a45ebe0defe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba70e90d-0127-4413-a308-4777f173896e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba70e90d-0127-4413-a308-4777f173896e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1426103278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da91eb76-b541-4f8d-918d-f84103ef5818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:52Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275f34f2-b3ca-4b03-ba5c-4279f66b2220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (275f34f2-b3ca-4b03-ba5c-4279f66b2220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318bb3c6-77fa-426f-b6f7-cb825996e35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (318bb3c6-77fa-426f-b6f7-cb825996e35d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da91eb76-b541-4f8d-918d-f84103ef5818', 'volume_name': 'volume-da91eb76-b541-4f8d-918d-f84103ef5818', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d867bc9a-2c78-40ec-833e-2191a812511d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d867bc9a-2c78-40ec-833e-2191a812511d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a425434-befe-4bfb-9254-a6d6f28f288f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:52 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume da91eb76-b541-4f8d-918d-f84103ef5818: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da91eb76-b541-4f8d-918d-f84103ef5818', 'volume_size': 1} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1426103278',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da91eb76-b541-4f8d-918d-f84103ef5818,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:52Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Creating volume da91eb76-b541-4f8d-918d-f84103ef5818 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:52 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:52 devstack sudo[114632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818 1073741824 Jun 19 04:34:52 devstack sudo[114632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:52 devstack sudo[114626]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8" returned: 0 in 0.908s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:52 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:52 devstack sudo[114634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8 Jun 19 04:34:52 devstack sudo[114634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:53 devstack sudo[114634]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-56337bf1-406c-4490-b6b5-d6db854c9da8" returned: 0 in 0.798s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-56337bf1-406c-4490-b6b5-d6db854c9da8" released by "delete_volume" :: held 1.767s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Created reservations ['7d4bfb20-d5d1-434a-a3ba-26745afdba8e', '6e7924e6-9441-4f0b-8c06-3965a766e0b3', 'a8aa43e8-0709-420f-9d11-b282e7bf356e', '80ae129b-923b-45d8-894a-2d14a5e9ddce'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:53 devstack sudo[114632]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818 1073741824" returned: 0 in 1.015s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:53 devstack sudo[114643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:53 devstack sudo[114643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:53 devstack sudo[114644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818 Jun 19 04:34:53 devstack sudo[114644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-45e42365-d1fd-48b3-b1f2-9200c60ef658-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:53 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-45e42365-d1fd-48b3-b1f2-9200c60ef658-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-quobyte-45e42365-d1fd-48b3-b1f2-9200c60ef658" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-45e42365-d1fd-48b3-b1f2-9200c60ef658" acquired by "delete_volume" :: waited 0.019s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb577c2-cf76-43e4-aed2-65cc0087fe63]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:54 devstack sudo[114647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 Jun 19 04:34:54 devstack sudo[114647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:54 devstack sudo[114643]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.743s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:54 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Deleted volume successfully. Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-b826a79f-2d7c-43da-8a83-e5a09c95afd1 tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-56337bf1-406c-4490-b6b5-d6db854c9da8-delete_volume" released by "delete_volume" :: held 2.760s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:54 devstack sudo[114644]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818" returned: 0 in 0.838s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a425434-befe-4bfb-9254-a6d6f28f288f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da91eb76-b541-4f8d-918d-f84103ef5818', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90c6901-939f-42cf-b224-3dda35d97a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:54 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume volume-da91eb76-b541-4f8d-918d-f84103ef5818 (da91eb76-b541-4f8d-918d-f84103ef5818): created successfully Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b90c6901-939f-42cf-b224-3dda35d97a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (a0dc99de-5f38-4e6c-b6ff-6a45ebe0defe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:54 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-0d6a286d-8b97-4e7b-af72-12e03f2a9e6a tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created volume successfully. Jun 19 04:34:54 devstack sudo[114647]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658" returned: 0 in 0.889s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:54 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:55 devstack sudo[114654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658 Jun 19 04:34:55 devstack sudo[114654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:55 devstack sudo[114654]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-45e42365-d1fd-48b3-b1f2-9200c60ef658" returned: 0 in 0.741s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:55 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-45e42365-d1fd-48b3-b1f2-9200c60ef658" released by "delete_volume" :: held 1.696s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:55 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Created reservations ['7ca55a52-656c-4082-ac87-93c37e531bc1', '0f5fef51-850d-40f8-8fbd-c3625cc75d15', 'd152b01f-421d-4ba4-ba37-acf34c83cdf4', '9ba190b6-f8a7-4fbf-8bd0-0e4db299d2e9'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:55 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:55 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:55 devstack sudo[114663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:55 devstack sudo[114663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (dafbcbb2-2b66-42c3-923d-2b6cb2311668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2408cd-d479-4adc-aed5-a2a3403de6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-ee3ac124-6502-4bea-8df6-c6fd5a763f92-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-ee3ac124-6502-4bea-8df6-c6fd5a763f92-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f2408cd-d479-4adc-aed5-a2a3403de6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685895781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8069f0-c4c3-47e6-8607-2727b315a6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:56Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d7212e-5a95-4805-8a44-e3601977faf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d7212e-5a95-4805-8a44-e3601977faf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796046cc-4344-421b-a14a-f1d893524d1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (796046cc-4344-421b-a14a-f1d893524d1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee8069f0-c4c3-47e6-8607-2727b315a6b4', 'volume_name': 'volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c97106e-7db5-40cf-bad5-96373f08e4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c97106e-7db5-40cf-bad5-96373f08e4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0753488c-e1a1-4268-9e40-5f680ae1858c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:56 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume ee8069f0-c4c3-47e6-8607-2727b315a6b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4', 'volume_size': 1} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685895781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee8069f0-c4c3-47e6-8607-2727b315a6b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:56Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Creating volume ee8069f0-c4c3-47e6-8607-2727b315a6b4 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:56 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:56 devstack sudo[114665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 1073741824 Jun 19 04:34:56 devstack sudo[114665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-quobyte-ee3ac124-6502-4bea-8df6-c6fd5a763f92" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-ee3ac124-6502-4bea-8df6-c6fd5a763f92" acquired by "delete_volume" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6c92ac-9655-4396-9933-037003a3f12e]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:56 devstack sudo[114667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 Jun 19 04:34:56 devstack sudo[114667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:56 devstack sudo[114663]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.990s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:56 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Deleted volume successfully. Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=131,cinder:UPDATE=193,cinder:DELETE=16,cinder:INSERT=43 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:34:56 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-731461c7-c5db-4fff-bde6-42929d826aa4 tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-45e42365-d1fd-48b3-b1f2-9200c60ef658-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (238cd093-305f-4e2f-b6d5-6583e526aaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4339bd13-e73c-409e-ad65-eba6817dfba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4339bd13-e73c-409e-ad65-eba6817dfba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004408340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e954e8-0018-4bd8-9971-cf171699a281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:57Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fa41cd-ca27-4bb2-bd7f-6bd420f33c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1fa41cd-ca27-4bb2-bd7f-6bd420f33c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb5432c-c9bc-4394-a4e0-9b9034b50968) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdb5432c-c9bc-4394-a4e0-9b9034b50968) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5e954e8-0018-4bd8-9971-cf171699a281', 'volume_name': 'volume-c5e954e8-0018-4bd8-9971-cf171699a281', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46285ca0-f94d-485b-abb2-d62f386ee39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46285ca0-f94d-485b-abb2-d62f386ee39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27195576-e8a7-4ec6-a79c-7a96c1567e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume c5e954e8-0018-4bd8-9971-cf171699a281: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5e954e8-0018-4bd8-9971-cf171699a281', 'volume_size': 1} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=163,cinder:SELECT=140,cinder:INSERT=50,cinder:DELETE=17 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:57 devstack sudo[114667]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (26f56e3f-e47b-4dd1-9521-eca04d23aa7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17372d32-483d-46f3-b6eb-b46716ffa981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92" returned: 0 in 1.037s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17372d32-483d-46f3-b6eb-b46716ffa981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-92086409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682b8511-43c0-40c8-83d5-a0fe09d2419b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:57Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:57 devstack sudo[114676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92 Jun 19 04:34:57 devstack sudo[114676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f96cd9-b0dd-4973-8616-11b3459a4213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80f96cd9-b0dd-4973-8616-11b3459a4213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60bfc10a-9529-4e96-a442-dbda3bf44954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60bfc10a-9529-4e96-a442-dbda3bf44954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '682b8511-43c0-40c8-83d5-a0fe09d2419b', 'volume_name': 'volume-682b8511-43c0-40c8-83d5-a0fe09d2419b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa3fce4-3390-4e16-a054-34042f4e3e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa3fce4-3390-4e16-a054-34042f4e3e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d72410b-0d9c-4c38-914c-f893338569df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:57 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume 682b8511-43c0-40c8-83d5-a0fe09d2419b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-682b8511-43c0-40c8-83d5-a0fe09d2419b', 'volume_size': 1} Jun 19 04:34:57 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:58 devstack sudo[114665]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 1073741824" returned: 0 in 1.541s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (ef468f6b-de79-4753-8cf6-3d0325b3374c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ab91d1-fa4c-45c7-b4e1-4d1f0eb3e1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1ab91d1-fa4c-45c7-b4e1-4d1f0eb3e1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1571963162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2723efb1-1981-49e0-8500-cdfeb3b8bbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:58Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9762db57-db60-4007-ad5c-e575058f8bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9762db57-db60-4007-ad5c-e575058f8bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:58 devstack sudo[114678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 Jun 19 04:34:58 devstack sudo[114678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c53280-9cf5-4678-a6f1-aa2366f37fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4c53280-9cf5-4678-a6f1-aa2366f37fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2723efb1-1981-49e0-8500-cdfeb3b8bbcc', 'volume_name': 'volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6bdb9b-6f68-40b2-8d70-3f46a5aa422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6bdb9b-6f68-40b2-8d70-3f46a5aa422c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782db7eb-6992-483e-a5f4-b3160c03eb89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume 2723efb1-1981-49e0-8500-cdfeb3b8bbcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc', 'volume_size': 1} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (17b79969-6759-4039-965a-e08b85e512a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a664b6-732a-4f5b-a8c0-7ff8af2c8a5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack sudo[114676]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3a664b6-732a-4f5b-a8c0-7ff8af2c8a5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184632666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417eb36c-7322-4f1d-9375-555ddfff59c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:59Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836d248c-ee90-40fc-9f56-feeb8b2880c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836d248c-ee90-40fc-9f56-feeb8b2880c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1012f03-9e30-44c1-a4ff-bb46ff3b01fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1012f03-9e30-44c1-a4ff-bb46ff3b01fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '417eb36c-7322-4f1d-9375-555ddfff59c3', 'volume_name': 'volume-417eb36c-7322-4f1d-9375-555ddfff59c3', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08f95d2-8699-4b5f-b396-e8fbd2501dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d08f95d2-8699-4b5f-b396-e8fbd2501dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7656ad72-e1bb-4c81-900a-67c8e25d7f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:58 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume 417eb36c-7322-4f1d-9375-555ddfff59c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-417eb36c-7322-4f1d-9375-555ddfff59c3', 'volume_size': 1} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee3ac124-6502-4bea-8df6-c6fd5a763f92" returned: 0 in 1.099s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-ee3ac124-6502-4bea-8df6-c6fd5a763f92" released by "delete_volume" :: held 2.207s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Created reservations ['2fe1ae4b-b2e0-4dcd-8d9f-ba414db9c906', '7d4130cf-816f-44e3-83bf-451c635af33d', '14433e6d-5d75-48de-a08a-5f1f49d4128c', '3565a13c-517d-4eb9-985e-cb04758c7f7d'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:58 devstack sudo[114682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:34:58 devstack sudo[114682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:58 devstack sudo[114678]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4" returned: 0 in 0.865s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] <== create_volume: return (2519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.523s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.882s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2004408340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5e954e8-0018-4bd8-9971-cf171699a281,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:57Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Creating volume c5e954e8-0018-4bd8-9971-cf171699a281 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:34:58 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:34:59 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0753488c-e1a1-4268-9e40-5f680ae1858c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7ee420-1393-4d74-9e84-fd4d2003f526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:34:59 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 (ee8069f0-c4c3-47e6-8607-2727b315a6b4): created successfully Jun 19 04:34:59 devstack sudo[114684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281 1073741824 Jun 19 04:34:59 devstack sudo[114684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e7ee420-1393-4d74-9e84-fd4d2003f526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (dafbcbb2-2b66-42c3-923d-2b6cb2311668) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:34:59 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-41b59169-0a7d-4b72-b35e-a7e79800a76c tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created volume successfully. Jun 19 04:34:59 devstack sudo[114682]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.750s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:34:59 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Deleted volume successfully. Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-491c5a6a-a1d1-4514-934d-8a51c26773ff tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-ee3ac124-6502-4bea-8df6-c6fd5a763f92-delete_volume" released by "delete_volume" :: held 3.327s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-1949386a-0909-448d-9f78-75287a43f9fa-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-1949386a-0909-448d-9f78-75287a43f9fa-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-quobyte-1949386a-0909-448d-9f78-75287a43f9fa" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-1949386a-0909-448d-9f78-75287a43f9fa" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef43a4b-55f0-4da0-96bf-20e2e922da05]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:34:59 devstack sudo[114684]: pam_unix(sudo:session): session closed for user root Jun 19 04:34:59 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281 1073741824" returned: 0 in 0.985s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:00 devstack sudo[114691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa Jun 19 04:35:00 devstack sudo[114691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:00 devstack sudo[114692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281 Jun 19 04:35:00 devstack sudo[114692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:00 devstack sudo[114692]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281" returned: 0 in 0.868s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.154s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-92086409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=682b8511-43c0-40c8-83d5-a0fe09d2419b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:57Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Creating volume 682b8511-43c0-40c8-83d5-a0fe09d2419b {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:00 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:00 devstack sudo[114691]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa" returned: 0 in 1.026s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:00 devstack sudo[114699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b 1073741824 Jun 19 04:35:00 devstack sudo[114699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27195576-e8a7-4ec6-a79c-7a96c1567e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5e954e8-0018-4bd8-9971-cf171699a281', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef6320d-3196-41c4-b1e6-24d6e2d8a012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:00 devstack sudo[114701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa Jun 19 04:35:00 devstack sudo[114701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:00 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume volume-c5e954e8-0018-4bd8-9971-cf171699a281 (c5e954e8-0018-4bd8-9971-cf171699a281): created successfully Jun 19 04:35:00 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef6320d-3196-41c4-b1e6-24d6e2d8a012) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (238cd093-305f-4e2f-b6d5-6583e526aaa1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:01 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-bf4ad3fe-d185-4584-89ff-3808ee00f0b5 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created volume successfully. Jun 19 04:35:01 devstack sudo[114701]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-1949386a-0909-448d-9f78-75287a43f9fa" returned: 0 in 0.712s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-1949386a-0909-448d-9f78-75287a43f9fa" released by "delete_volume" :: held 1.782s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Created reservations ['a6241bc8-b86e-4a45-aea4-e131ddad0823', '4435a64a-f11e-4056-87cd-f43d0ab24dae', '935242e7-d171-4383-bd54-15a53018ffbc', 'ffa0003b-6195-4d3e-87fd-25f68f039ad2'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:01 devstack sudo[114699]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b 1073741824" returned: 0 in 0.920s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:01 devstack sudo[114711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:01 devstack sudo[114711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:01 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:01 devstack sudo[114713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b Jun 19 04:35:01 devstack sudo[114713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-9607f65e-82aa-43e4-ae2d-9c8b93173c00-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-9607f65e-82aa-43e4-ae2d-9c8b93173c00-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "cinder-quobyte-9607f65e-82aa-43e4-ae2d-9c8b93173c00" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-9607f65e-82aa-43e4-ae2d-9c8b93173c00" acquired by "delete_volume" :: waited 0.026s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[76ce4704-b22e-4c98-9aa1-c0909e3dedac]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:02 devstack sudo[114715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 Jun 19 04:35:02 devstack sudo[114715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:02 devstack sudo[114713]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b" returned: 0 in 0.728s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] <== create_volume: return (1706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.410s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1571963162',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2723efb1-1981-49e0-8500-cdfeb3b8bbcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:58Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Creating volume 2723efb1-1981-49e0-8500-cdfeb3b8bbcc {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:02 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:02 devstack sudo[114719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc 1073741824 Jun 19 04:35:02 devstack sudo[114719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d72410b-0d9c-4c38-914c-f893338569df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-682b8511-43c0-40c8-83d5-a0fe09d2419b', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:02 devstack sudo[114711]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a78e0e2-399a-4422-9fba-8a6d529bfe17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.882s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:02 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume volume-682b8511-43c0-40c8-83d5-a0fe09d2419b (682b8511-43c0-40c8-83d5-a0fe09d2419b): created successfully Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a78e0e2-399a-4422-9fba-8a6d529bfe17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (26f56e3f-e47b-4dd1-9521-eca04d23aa7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Deleted volume successfully. Jun 19 04:35:02 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-12a5da30-06df-4881-8c6f-0aa1e7699f8b tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created volume successfully. Jun 19 04:35:02 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1426649c-f45a-42ed-ab7b-de4e97ca6e9a tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-1949386a-0909-448d-9f78-75287a43f9fa-delete_volume" released by "delete_volume" :: held 2.963s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00" returned: 0 in 0.948s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:03 devstack sudo[114715]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:03 devstack sudo[114724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00 Jun 19 04:35:03 devstack sudo[114724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:03 devstack sudo[114719]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc 1073741824" returned: 0 in 1.081s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:03 devstack sudo[114730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc Jun 19 04:35:03 devstack sudo[114730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:03 devstack sudo[114724]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:03 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-9607f65e-82aa-43e4-ae2d-9c8b93173c00" returned: 0 in 0.781s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-quobyte-9607f65e-82aa-43e4-ae2d-9c8b93173c00" released by "delete_volume" :: held 1.797s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Created reservations ['7cc7ce52-d5d7-4768-beee-5db5d5af6acd', '18ca05a1-a26a-4bb2-9159-713723b55dea', '33478a42-77da-4829-993f-e088ceb67ae3', 'aa129721-f43c-4e27-bdc1-3382e051e389'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:04 devstack sudo[114733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:04 devstack sudo[114733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:04 devstack sudo[114730]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc" returned: 0 in 0.848s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] <== create_volume: return (1991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.997s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.878s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:34:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1184632666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=417eb36c-7322-4f1d-9375-555ddfff59c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1c6339dd2b724f278830a4b302c2fc7e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:34:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:34:59Z,use_quota=True,user_id='f2ef23ed28144073a6be7f9a56346e49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Creating volume 417eb36c-7322-4f1d-9375-555ddfff59c3 {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:04 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (782db7eb-6992-483e-a5f4-b3160c03eb89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack sudo[114736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3 1073741824 Jun 19 04:35:04 devstack sudo[114736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66358b9d-0825-4999-9dcb-85885223fed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:04 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc (2723efb1-1981-49e0-8500-cdfeb3b8bbcc): created successfully Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66358b9d-0825-4999-9dcb-85885223fed9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:04 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (ef468f6b-de79-4753-8cf6-3d0325b3374c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:04 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-86126e0c-168f-4eb1-a189-56404ecb1593 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created volume successfully. Jun 19 04:35:05 devstack sudo[114733]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.856s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:05 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:05 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Deleted volume successfully. Jun 19 04:35:05 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-1446ff54-80e2-42d1-8694-e1610255513c tempest-CreateVolumesFromImageTest-691499156 None] Lock "cinder-9607f65e-82aa-43e4-ae2d-9c8b93173c00-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:05 devstack sudo[114736]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3 1073741824" returned: 0 in 1.167s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:05 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:05 devstack sudo[114743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3 Jun 19 04:35:05 devstack sudo[114743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:06 devstack sudo[114743]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3" returned: 0 in 0.879s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:06 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] <== create_volume: return (2101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:06 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7656ad72-e1bb-4c81-900a-67c8e25d7f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-417eb36c-7322-4f1d-9375-555ddfff59c3', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20fbf05-a1e2-43f0-bf6a-ab820b3237f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:06 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Volume volume-417eb36c-7322-4f1d-9375-555ddfff59c3 (417eb36c-7322-4f1d-9375-555ddfff59c3): created successfully Jun 19 04:35:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20fbf05-a1e2-43f0-bf6a-ab820b3237f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:06 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Flow 'volume_create_manager' (17b79969-6759-4039-965a-e08b85e512a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:06 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-eab91f29-46db-4b08-8aa2-de7902b13872 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created volume successfully. Jun 19 04:35:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-417eb36c-7322-4f1d-9375-555ddfff59c3-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-417eb36c-7322-4f1d-9375-555ddfff59c3-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-quobyte-417eb36c-7322-4f1d-9375-555ddfff59c3" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:07 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-417eb36c-7322-4f1d-9375-555ddfff59c3" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:07 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c2b323-ea13-4678-b633-c165c0491496]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:07 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:07 devstack sudo[114746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3 Jun 19 04:35:07 devstack sudo[114746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:08 devstack sudo[114746]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3" returned: 0 in 0.839s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:08 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:08 devstack sudo[114752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3 Jun 19 04:35:08 devstack sudo[114752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:09 devstack sudo[114752]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-417eb36c-7322-4f1d-9375-555ddfff59c3" returned: 0 in 0.776s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-417eb36c-7322-4f1d-9375-555ddfff59c3" released by "delete_volume" :: held 1.672s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created reservations ['50912e7c-b790-4840-96dd-6f7b86234b41', '7d490e52-a856-4d1d-b3d6-a9de6a777c48', '83d6e015-bc25-46f3-ac6c-555b43726cda', '5dfc1329-8297-46ce-b255-210e21cd17eb'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:09 devstack sudo[114756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:09 devstack sudo[114756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-2723efb1-1981-49e0-8500-cdfeb3b8bbcc-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:09 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-2723efb1-1981-49e0-8500-cdfeb3b8bbcc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-quobyte-2723efb1-1981-49e0-8500-cdfeb3b8bbcc" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-2723efb1-1981-49e0-8500-cdfeb3b8bbcc" acquired by "delete_volume" :: waited 0.021s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a822b0-4465-475f-8cac-e35590f44666]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:10 devstack sudo[114758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc Jun 19 04:35:10 devstack sudo[114758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:10 devstack sudo[114756]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.751s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:10 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Deleted volume successfully. Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9a8b13ba-0273-4304-93c7-ae86a27e78ce tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-417eb36c-7322-4f1d-9375-555ddfff59c3-delete_volume" released by "delete_volume" :: held 2.696s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Flow 'volume_create_manager' (fa385e34-be55-410f-bf7b-c61600195ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0329e6f-e56a-4386-a251-fd176ffd4185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0329e6f-e56a-4386-a251-fd176ffd4185) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053a8957-a182-4fd5-855b-5614a122425e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa28bfc18bc4f8290c0b1ae88fe871a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:11Z,use_quota=True,user_id='1915cc33c2824b16b51fb1cd432c07bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78f40e4-2c6e-424c-876a-cbd82163fddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d78f40e4-2c6e-424c-876a-cbd82163fddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047f8c63-56a3-42dd-abcb-d99df8cdaf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG cinder.image.glance [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Creating Keystone auth plugin from conf {{(pid=93769) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jun 19 04:35:10 devstack sudo[114758]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc" returned: 0 in 0.929s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:10 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:11 devstack sudo[114765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc Jun 19 04:35:11 devstack sudo[114765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047f8c63-56a3-42dd-abcb-d99df8cdaf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '053a8957-a182-4fd5-855b-5614a122425e', 'volume_name': 'volume-053a8957-a182-4fd5-855b-5614a122425e', 'volume_size': 1, 'image_id': 'dbd64549-c422-448a-ae99-8861c1d720a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbd64549-c422-448a-ae99-8861c1d720a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e372e0bfb91408b0b3cc811fd061b44', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1aa28bfc18bc4f8290c0b1ae88fe871a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '450ea8f5095fe77c5827007bd1d4d045891b6917c3a5a3a4b25491b0c76b38c258f59e723e407b0239efc2a0ce6df08f5c183ec13243ae9231dc9c91d3878b0b', 'id': 'dbd64549-c422-448a-ae99-8861c1d720a3', 'created_at': datetime.datetime(2026, 6, 19, 2, 35, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 35, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbd64549-c422-448a-ae99-8861c1d720a3/file', 'properties': {}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419085ec-59c1-4b50-81fc-7fa436c8d335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (419085ec-59c1-4b50-81fc-7fa436c8d335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffcccbd-3432-429d-85a0-38aa941de07d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:11 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Volume 053a8957-a182-4fd5-855b-5614a122425e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-053a8957-a182-4fd5-855b-5614a122425e', 'volume_size': 1, 'image_id': 'dbd64549-c422-448a-ae99-8861c1d720a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbd64549-c422-448a-ae99-8861c1d720a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e372e0bfb91408b0b3cc811fd061b44', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1aa28bfc18bc4f8290c0b1ae88fe871a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '450ea8f5095fe77c5827007bd1d4d045891b6917c3a5a3a4b25491b0c76b38c258f59e723e407b0239efc2a0ce6df08f5c183ec13243ae9231dc9c91d3878b0b', 'id': 'dbd64549-c422-448a-ae99-8861c1d720a3', 'created_at': datetime.datetime(2026, 6, 19, 2, 35, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 35, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbd64549-c422-448a-ae99-8861c1d720a3/file', 'properties': {}}, 'image_service': } Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Trying to clone 053a8957-a182-4fd5-855b-5614a122425e from image dbd64549-c422-448a-ae99-8861c1d720a3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/dbd64549-c422-448a-ae99-8861c1d720a3', 'metadata': {}}]). {{(pid=93769) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jun 19 04:35:11 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Image download 0.00 MB at 0.00 MB/s Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8b6d9c-c05a-4dee-a9cf-7c3fb0694e75]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:11 devstack sudo[114767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD Jun 19 04:35:11 devstack sudo[114767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:11 devstack sudo[114765]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-2723efb1-1981-49e0-8500-cdfeb3b8bbcc" returned: 0 in 0.693s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-2723efb1-1981-49e0-8500-cdfeb3b8bbcc" released by "delete_volume" :: held 1.688s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created reservations ['d554f745-ad2b-4fb0-9322-16461faea6a9', '5efa47b3-ef49-486f-b4f1-58639bb08ab1', '671c666d-0868-4a6d-b5b2-f53067c7a7d0', 'ada76dcb-096c-4e36-a533-ca2aba6d74e7'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:11 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:11 devstack sudo[114771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:11 devstack sudo[114771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-682b8511-43c0-40c8-83d5-a0fe09d2419b-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:12 devstack sudo[114767]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD" returned: 0 in 0.838s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-682b8511-43c0-40c8-83d5-a0fe09d2419b-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-quobyte-682b8511-43c0-40c8-83d5-a0fe09d2419b" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-682b8511-43c0-40c8-83d5-a0fe09d2419b" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[335713f3-c4fc-4e25-a499-885e22e471d8]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:12 devstack sudo[114775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD Jun 19 04:35:12 devstack sudo[114775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:12 devstack sudo[114776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b Jun 19 04:35:12 devstack sudo[114776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:12 devstack sudo[114771]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.907s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:12 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Deleted volume successfully. Jun 19 04:35:12 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-baaab9f0-275d-4b72-b466-1cac0df69cf9 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-2723efb1-1981-49e0-8500-cdfeb3b8bbcc-delete_volume" released by "delete_volume" :: held 2.917s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:13 devstack sudo[114775]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD" returned: 1 in 0.897s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:35:13 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Temporary image dbd64549-c422-448a-ae99-8861c1d720a3 is fetched for user 1915cc33c2824b16b51fb1cd432c07bc. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jun 19 04:35:13 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf836024-bec6-4010-abb8-70a5691936a9]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:13 devstack sudo[114776]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b" returned: 0 in 0.845s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:13 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:13 devstack sudo[114787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b Jun 19 04:35:13 devstack sudo[114787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:13 devstack sudo[114786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD Jun 19 04:35:13 devstack sudo[114786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:14 devstack sudo[114787]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-682b8511-43c0-40c8-83d5-a0fe09d2419b" returned: 0 in 0.841s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-682b8511-43c0-40c8-83d5-a0fe09d2419b" released by "delete_volume" :: held 1.759s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:14 devstack sudo[114786]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD" returned: 0 in 0.922s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created reservations ['fb3818ff-b85f-484e-b6d6-6bc68c4e64b2', '9eb4efac-4c23-42c7-8828-2757c2dc69de', 'a9faf584-a7fc-4bd4-8859-59cc95765107', '6952b548-290d-4f80-b1ff-fcc7c6306cbc'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:14 devstack sudo[114793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD Jun 19 04:35:14 devstack sudo[114793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:14 devstack sudo[114795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:14 devstack sudo[114795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-c5e954e8-0018-4bd8-9971-cf171699a281-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-c5e954e8-0018-4bd8-9971-cf171699a281-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-quobyte-c5e954e8-0018-4bd8-9971-cf171699a281" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-c5e954e8-0018-4bd8-9971-cf171699a281" acquired by "delete_volume" :: waited 0.020s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[81c60f14-515e-4a03-8df1-375488a5662f]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:14 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:14 devstack sudo[114797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281 Jun 19 04:35:14 devstack sudo[114797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:15 devstack sudo[114793]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD" returned: 1 in 0.885s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:10Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=053a8957-a182-4fd5-855b-5614a122425e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aa28bfc18bc4f8290c0b1ae88fe871a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:11Z,use_quota=True,user_id='1915cc33c2824b16b51fb1cd432c07bc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Creating volume 053a8957-a182-4fd5-855b-5614a122425e {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:15 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:15 devstack sudo[114802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e 1073741824 Jun 19 04:35:15 devstack sudo[114802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:15 devstack sudo[114795]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.960s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:15 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Deleted volume successfully. Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-867309e8-26be-48ce-92e6-caee3815e0ca tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-682b8511-43c0-40c8-83d5-a0fe09d2419b-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:15 devstack sudo[114797]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281" returned: 0 in 0.981s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:15 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:15 devstack sudo[114808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281 Jun 19 04:35:15 devstack sudo[114808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:16 devstack sudo[114802]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e 1073741824" returned: 0 in 0.969s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:16 devstack sudo[114814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e Jun 19 04:35:16 devstack sudo[114814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:16 devstack sudo[114808]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-c5e954e8-0018-4bd8-9971-cf171699a281" returned: 0 in 0.717s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-c5e954e8-0018-4bd8-9971-cf171699a281" released by "delete_volume" :: held 1.748s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created reservations ['ada9d077-dc54-482c-9785-502ce2a7f75a', '82b10e92-5ce8-4924-8cb4-e8978accdbf4', '654a0b48-0746-4364-953c-02f37068cb6e', '2216ad16-7e81-4e40-bad6-85f445cdf0bb'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:16 devstack sudo[114851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:16 devstack sudo[114851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-ee8069f0-c4c3-47e6-8607-2727b315a6b4-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-ee8069f0-c4c3-47e6-8607-2727b315a6b4-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:16 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-quobyte-ee8069f0-c4c3-47e6-8607-2727b315a6b4" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-ee8069f0-c4c3-47e6-8607-2727b315a6b4" acquired by "delete_volume" :: waited 0.031s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bdff9c3-373f-4cc0-a1cf-aa8cff59dec5]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:17 devstack sudo[114814]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e" returned: 0 in 1.036s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] <== create_volume: return (2076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.083s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Attempting download of dbd64549-c422-448a-ae99-8861c1d720a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbd64549-c422-448a-ae99-8861c1d720a3', 'metadata': {}}])) to volume 053a8957-a182-4fd5-855b-5614a122425e. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jun 19 04:35:17 devstack sudo[114856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 Jun 19 04:35:17 devstack sudo[114856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4bbf962-f658-4f35-ace1-573eebbbe591]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbd64549-c422-448a-ae99-8861c1d720a3_bsgiig2v {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:17 devstack sudo[114851]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:17 devstack sudo[114859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbd64549-c422-448a-ae99-8861c1d720a3_bsgiig2v Jun 19 04:35:17 devstack sudo[114859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.840s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:17 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Deleted volume successfully. Jun 19 04:35:17 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a2684c01-fba2-4fe3-9acc-e4cdb652850d tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-c5e954e8-0018-4bd8-9971-cf171699a281-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:18 devstack sudo[114856]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4" returned: 0 in 1.038s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:18 devstack sudo[114859]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dbd64549-c422-448a-ae99-8861c1d720a3_bsgiig2v" returned: 0 in 0.814s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbd64549-c422-448a-ae99-8861c1d720a3_bsgiig2v {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:18 devstack sudo[114866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4 Jun 19 04:35:18 devstack sudo[114866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:18 devstack sudo[114867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbd64549-c422-448a-ae99-8861c1d720a3_bsgiig2v Jun 19 04:35:18 devstack sudo[114867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:18 devstack sudo[114866]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:18 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-ee8069f0-c4c3-47e6-8607-2727b315a6b4" returned: 0 in 0.714s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:18 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-ee8069f0-c4c3-47e6-8607-2727b315a6b4" released by "delete_volume" :: held 1.823s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:18 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created reservations ['71f322f8-a2c2-4b2e-8cef-22801f95a666', '69ea7eae-feca-49f5-be7a-318e80cf160e', 'd9092ad7-d2a1-4976-8e28-af4ada4923b8', '7032547a-e6c7-40ea-bb4d-bbbeadafdad2'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:19 devstack sudo[114873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:19 devstack sudo[114873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:19 devstack sudo[114867]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbd64549-c422-448a-ae99-8861c1d720a3_bsgiig2v" returned: 1 in 0.954s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dbd64549-c422-448a-ae99-8861c1d720a3_bsgiig2v' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fbd71f-be40-49d8-860a-7af144365429]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-da91eb76-b541-4f8d-918d-f84103ef5818-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:19 devstack sudo[114875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD Jun 19 04:35:19 devstack sudo[114875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-da91eb76-b541-4f8d-918d-f84103ef5818-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "cinder-quobyte-da91eb76-b541-4f8d-918d-f84103ef5818" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-da91eb76-b541-4f8d-918d-f84103ef5818" acquired by "delete_volume" :: waited 0.040s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c07e20-d468-4a44-9895-850979896054]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:19 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:19 devstack sudo[114877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818 Jun 19 04:35:19 devstack sudo[114877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:20 devstack sudo[114873]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 1.009s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:20 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Deleted volume successfully. Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-ef829b28-0039-4f6d-8fc6-dc844dbc6d32 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-ee8069f0-c4c3-47e6-8607-2727b315a6b4-delete_volume" released by "delete_volume" :: held 3.151s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:20 devstack sudo[114875]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD" returned: 0 in 1.060s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:20 devstack sudo[114882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD Jun 19 04:35:20 devstack sudo[114882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:20 devstack sudo[114877]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818" returned: 0 in 0.958s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:20 devstack sudo[114887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818 Jun 19 04:35:20 devstack sudo[114887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Flow 'volume_create_manager' (4ef93deb-fe3a-4d9b-ac7b-9912ed8ce1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9720442e-7966-4891-8ec9-74c0a9b0aa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:20 devstack sudo[114882]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9720442e-7966-4891-8ec9-74c0a9b0aa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1815813903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e59cb9-423e-4f73-b502-4e9a0239aeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c939b34302ae4679a77d896ec45fd93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:21Z,use_quota=True,user_id='fd1ba78baf274f62938ab4d11c36d1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b4fa5e-1d71-434b-88fa-48a215547f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b4fa5e-1d71-434b-88fa-48a215547f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e95ca4-403c-422e-b7f7-02fd702a400f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0e95ca4-403c-422e-b7f7-02fd702a400f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11e59cb9-423e-4f73-b502-4e9a0239aeef', 'volume_name': 'volume-11e59cb9-423e-4f73-b502-4e9a0239aeef', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a43d2f-6996-472c-bffa-1ec724f67b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:20 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3a43d2f-6996-472c-bffa-1ec724f67b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1964ea27-6204-44d9-aaaf-e95d601b55d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:21 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Volume 11e59cb9-423e-4f73-b502-4e9a0239aeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11e59cb9-423e-4f73-b502-4e9a0239aeef', 'volume_size': 1} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1815813903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11e59cb9-423e-4f73-b502-4e9a0239aeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c939b34302ae4679a77d896ec45fd93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:21Z,use_quota=True,user_id='fd1ba78baf274f62938ab4d11c36d1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)}" {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Creating volume 11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:21 devstack cinder-volume[93769]: INFO cinder.volume.drivers.remotefs [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] casted to osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef 1073741824 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD" returned: 1 in 0.867s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] dbd64549-c422-448a-ae99-8861c1d720a3 was raw, converting to raw {{(pid=93769) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:21 devstack sudo[114893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef 1073741824 Jun 19 04:35:21 devstack sudo[114893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:21 devstack sudo[114887]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-da91eb76-b541-4f8d-918d-f84103ef5818" returned: 0 in 0.664s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:21 devstack sudo[114894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e Jun 19 04:35:21 devstack sudo[114894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-quobyte-da91eb76-b541-4f8d-918d-f84103ef5818" released by "delete_volume" :: held 1.688s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Created reservations ['0ad70fed-a362-48ec-ac68-408208fff8c7', 'cad22695-7e5e-4cfc-a2de-dff2e86c13fc', 'a27c681c-ef0f-4d3e-bbb6-73e4d625e003', '57951232-aed1-494d-b7d8-b0b2a033e14d'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:21 devstack sudo[114897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:21 devstack sudo[114897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:21 devstack sudo[114894]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e" returned: 0 in 0.832s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dbd64549-c422-448a-ae99-8861c1d720a3_mxbq8yqmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:35:21 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Converted 0.00 MB image at 0.00 MB/s Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:21 devstack sudo[114907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e 1G Jun 19 04:35:21 devstack sudo[114907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:21 devstack sudo[114897]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.742s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:21 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Deleted volume successfully. Jun 19 04:35:21 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9dc1624d-e9e7-48b4-b414-e4564cdaaf92 tempest-CreateVolumesFromSourceVolumeTest-1455445069 None] Lock "cinder-da91eb76-b541-4f8d-918d-f84103ef5818-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:22 devstack sudo[114893]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef 1073741824" returned: 0 in 1.052s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:22 devstack sudo[114910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef Jun 19 04:35:22 devstack sudo[114910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:22 devstack sudo[114907]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e 1G" returned: 0 in 0.777s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01d606f-aedf-4be9-985e-d377a53774a9]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:22 devstack sudo[114916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e Jun 19 04:35:22 devstack sudo[114916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef" returned: 0 in 0.734s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:22 devstack sudo[114910]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'} {{(pid=93769) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1964ea27-6204-44d9-aaaf-e95d601b55d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11e59cb9-423e-4f73-b502-4e9a0239aeef', 'volume_size': 1}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083c4de5-1126-4ac3-80cc-65696f1c585e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:22 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Volume volume-11e59cb9-423e-4f73-b502-4e9a0239aeef (11e59cb9-423e-4f73-b502-4e9a0239aeef): created successfully Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (083c4de5-1126-4ac3-80cc-65696f1c585e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:22 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Flow 'volume_create_manager' (4ef93deb-fe3a-4d9b-ac7b-9912ed8ce1d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:22 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-36f2334b-e414-44a3-92bd-e4020c984333 tempest-SnapshotDependencyTests-83851385 None] Created volume successfully. Jun 19 04:35:23 devstack sudo[114916]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e" returned: 0 in 0.827s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:23 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:23 devstack sudo[114920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e Jun 19 04:35:23 devstack sudo[114920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:24 devstack sudo[114920]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e" returned: 1 in 0.758s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Downloaded image dbd64549-c422-448a-ae99-8861c1d720a3 ((None, [{'url': 'file:///opt/stack/data/glance/images/dbd64549-c422-448a-ae99-8861c1d720a3', 'metadata': {}}])) to volume 053a8957-a182-4fd5-855b-5614a122425e successfully. {{(pid=93769) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Temporary image dbd64549-c422-448a-ae99-8861c1d720a3 for user 1915cc33c2824b16b51fb1cd432c07bc is deleted. {{(pid=93769) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.volume.volume_utils [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Marking volume 053a8957-a182-4fd5-855b-5614a122425e as bootable. {{(pid=93769) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Copying metadata from image dbd64549-c422-448a-ae99-8861c1d720a3 to 053a8957-a182-4fd5-855b-5614a122425e. {{(pid=93769) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Creating volume glance metadata for volume 053a8957-a182-4fd5-855b-5614a122425e backed by image dbd64549-c422-448a-ae99-8861c1d720a3 with: {'image_id': 'dbd64549-c422-448a-ae99-8861c1d720a3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5e372e0bfb91408b0b3cc811fd061b44', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=93769) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Creating offline snapshot 8e489af5-0190-4478-bd1e-4e0c193e924a of volume 11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1552dee-7f4d-42a6-879e-ce711488ab77]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ffcccbd-3432-429d-85a0-38aa941de07d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-053a8957-a182-4fd5-855b-5614a122425e', 'volume_size': 1, 'image_id': 'dbd64549-c422-448a-ae99-8861c1d720a3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dbd64549-c422-448a-ae99-8861c1d720a3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5e372e0bfb91408b0b3cc811fd061b44', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1aa28bfc18bc4f8290c0b1ae88fe871a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '450ea8f5095fe77c5827007bd1d4d045891b6917c3a5a3a4b25491b0c76b38c258f59e723e407b0239efc2a0ce6df08f5c183ec13243ae9231dc9c91d3878b0b', 'id': 'dbd64549-c422-448a-ae99-8861c1d720a3', 'created_at': datetime.datetime(2026, 6, 19, 2, 35, 8, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 6, 19, 2, 35, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dbd64549-c422-448a-ae99-8861c1d720a3/file', 'properties': {}}, 'image_service': }' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d4cb76-7dba-4eb7-b459-780e0d1021d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:24 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Volume volume-053a8957-a182-4fd5-855b-5614a122425e (053a8957-a182-4fd5-855b-5614a122425e): created successfully Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07d4cb76-7dba-4eb7-b459-780e0d1021d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Flow 'volume_create_manager' (fa385e34-be55-410f-bf7b-c61600195ef5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:24 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6de6607e-550d-4e22-8fef-2c0dd6a4a3b6 tempest-VolumeImageDependencyTests-246583434 None] Created volume successfully. Jun 19 04:35:24 devstack sudo[114925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef Jun 19 04:35:24 devstack sudo[114925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Acquiring lock "cinder-053a8957-a182-4fd5-855b-5614a122425e-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Lock "cinder-053a8957-a182-4fd5-855b-5614a122425e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:24 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Acquiring lock "cinder-quobyte-053a8957-a182-4fd5-855b-5614a122425e" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:25 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Lock "cinder-quobyte-053a8957-a182-4fd5-855b-5614a122425e" acquired by "delete_volume" :: waited 0.028s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:25 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6c7430-bf42-43f6-98de-c2eb56febc01]: (4, 'raw') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:25 devstack sudo[114925]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef" returned: 0 in 0.825s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a 1G {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:25 devstack sudo[114930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e Jun 19 04:35:25 devstack sudo[114930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:25 devstack sudo[114931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a 1G Jun 19 04:35:25 devstack sudo[114931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:25 devstack sudo[114930]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e" returned: 0 in 0.783s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:25 devstack sudo[114931]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:25 devstack sudo[114939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e Jun 19 04:35:25 devstack sudo[114939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a 1G" returned: 0 in 0.770s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:25 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11e59cb9-423e-4f73-b502-4e9a0239aeef -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:25 devstack sudo[114941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11e59cb9-423e-4f73-b502-4e9a0239aeef -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a Jun 19 04:35:25 devstack sudo[114941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:26 devstack sudo[114939]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e" returned: 1 in 0.724s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e' failed. Not Retrying. {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 19 04:35:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:26 devstack sudo[114949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e Jun 19 04:35:26 devstack sudo[114949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:26 devstack sudo[114941]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-11e59cb9-423e-4f73-b502-4e9a0239aeef -F qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a" returned: 0 in 0.671s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:26 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a is being set with open permissions: ugo+rw Jun 19 04:35:26 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:26 devstack sudo[114951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a Jun 19 04:35:26 devstack sudo[114951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:27 devstack sudo[114949]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-053a8957-a182-4fd5-855b-5614a122425e" returned: 0 in 0.649s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Lock "cinder-quobyte-053a8957-a182-4fd5-855b-5614a122425e" released by "delete_volume" :: held 2.220s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:27 devstack sudo[114951]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a" returned: 0 in 0.632s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Created reservations ['a70709cf-ca06-4ab7-9fe7-30ea7a8b69e5', '65716f76-eac2-4bd5-8025-7ebc4cb06a4c', '7059d442-a56b-439d-8099-d2840e2e522f', '2c27ec18-7309-4718-b603-90971a16d273'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:27 devstack sudo[114955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.info Jun 19 04:35:27 devstack sudo[114955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:27 devstack sudo[114957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:27 devstack sudo[114957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:27 devstack sudo[114955]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.info" returned: 0 in 0.634s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:27 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.info is being set with open permissions: ugo+rw Jun 19 04:35:27 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.info {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:27 devstack sudo[114961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.info Jun 19 04:35:27 devstack sudo[114961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:28 devstack sudo[114957]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.626s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:28 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Deleted volume successfully. Jun 19 04:35:28 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-a260524b-6f64-4d8c-b065-f4aad22130ca tempest-VolumeImageDependencyTests-246583434 None] Lock "cinder-053a8957-a182-4fd5-855b-5614a122425e-delete_volume" released by "delete_volume" :: held 3.098s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:28 devstack sudo[114961]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.info" returned: 0 in 0.656s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:28 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.291s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:28 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-6c9e26f6-13de-47b7-8f71-9200cb7c2f20 tempest-SnapshotDependencyTests-83851385 None] Create snapshot completed successfully Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.flows.manager.create_volume [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=93769) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Flow 'volume_create_manager' (dce4eb1a-19b1-4842-b346-4020a790d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b6ead2-07bd-42b1-b85b-e6c9a73ab8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b6ead2-07bd-42b1-b85b-e6c9a73ab8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-06-19T02:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a23c333-6bb6-4954-bb9a-5022aa70bfed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c939b34302ae4679a77d896ec45fd93f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-06-19T02:35:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8e489af5-0190-4478-bd1e-4e0c193e924a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-06-19T02:35:30Z,use_quota=True,user_id='fd1ba78baf274f62938ab4d11c36d1dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b8623d4b-edcc-4a2f-9ad6-472d81082c15),volume_type_id=b8623d4b-edcc-4a2f-9ad6-472d81082c15)' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3fde02-9d87-4c19-bf4e-c9fb5ff1f116) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b3fde02-9d87-4c19-bf4e-c9fb5ff1f116) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a4a19a-a04f-44d0-af61-d5f020c38242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a4a19a-a04f-44d0-af61-d5f020c38242) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '0a23c333-6bb6-4954-bb9a-5022aa70bfed', 'volume_name': 'volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed', 'volume_size': 1, 'snapshot_id': '8e489af5-0190-4478-bd1e-4e0c193e924a'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ce2f4c-748f-4073-a305-02d751b5fd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76ce2f4c-748f-4073-a305-02d751b5fd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23182e0-fef0-4aff-b5ef-a01424d5381c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:30 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Volume 0a23c333-6bb6-4954-bb9a-5022aa70bfed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed', 'volume_size': 1, 'snapshot_id': '8e489af5-0190-4478-bd1e-4e0c193e924a'} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "cinder-quobyte-8e489af5-0190-4478-bd1e-4e0c193e924a-0a23c333-6bb6-4954-bb9a-5022aa70bfed" by "_create_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-8e489af5-0190-4478-bd1e-4e0c193e924a-0a23c333-6bb6-4954-bb9a-5022aa70bfed" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Creating volume 0a23c333-6bb6-4954-bb9a-5022aa70bfed from snapshot 8e489af5-0190-4478-bd1e-4e0c193e924a {{(pid=93769) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Selected osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c as target Quobyte volume. {{(pid=93769) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "cinder-quobyte-0a23c333-6bb6-4954-bb9a-5022aa70bfed" by "_copy_volume_from_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-0a23c333-6bb6-4954-bb9a-5022aa70bfed" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] snapshot: 8e489af5-0190-4478-bd1e-4e0c193e924a, volume: 0a23c333-6bb6-4954-bb9a-5022aa70bfed, {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[322fa559-ca98-45ff-9180-24d2c0cc89cc]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:30 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:30 devstack sudo[114964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a Jun 19 04:35:30 devstack sudo[114964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:31 devstack sudo[114964]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a" returned: 0 in 0.768s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11e59cb9-423e-4f73-b502-4e9a0239aeef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:35:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] will copy from snapshot at /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jun 19 04:35:31 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Creating direct copy from snapshot {{(pid=93769) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jun 19 04:35:31 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba99eb43-9d54-49b2-bb70-a7ee853230ca]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:31 devstack sudo[114969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef Jun 19 04:35:31 devstack sudo[114969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:31 devstack sudo[114969]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef" returned: 0 in 0.719s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:31 devstack cinder-volume[93769]: DEBUG cinder.utils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Path /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed not found in is_blk_device check {{(pid=93769) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jun 19 04:35:31 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:31 devstack sudo[114975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed Jun 19 04:35:31 devstack sudo[114975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:36 devstack sudo[114975]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed" returned: 0 in 4.299s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:36 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[6466483a-23ef-4d5a-9c08-0614efe1408c]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:36 devstack sudo[114988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef Jun 19 04:35:36 devstack sudo[114988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:36 devstack sudo[114988]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef" returned: 0 in 0.878s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:36 devstack cinder-volume[93769]: DEBUG cinder.image.image_utils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Image conversion details: src /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef, size 1024.00 MB, duration 4.30 sec, destination /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed {{(pid=93769) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jun 19 04:35:36 devstack cinder-volume[93769]: INFO cinder.image.image_utils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Converted 1024.00 MB image at 238.15 MB/s Jun 19 04:35:36 devstack cinder-volume[93769]: WARNING cinder.volume.drivers.remotefs [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed is being set with open permissions: ugo+rw Jun 19 04:35:36 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:37 devstack sudo[114993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed Jun 19 04:35:37 devstack sudo[114993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:37 devstack sudo[114993]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed" returned: 0 in 0.605s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-0a23c333-6bb6-4954-bb9a-5022aa70bfed" released by "_copy_volume_from_snapshot" :: held 7.372s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:37 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-8e489af5-0190-4478-bd1e-4e0c193e924a-0a23c333-6bb6-4954-bb9a-5022aa70bfed" released by "_create_volume_from_snapshot" :: held 7.407s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:37 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.425s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b23182e0-fef0-4aff-b5ef-a01424d5381c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed', 'volume_size': 1, 'snapshot_id': '8e489af5-0190-4478-bd1e-4e0c193e924a'}' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f217f99e-2107-4c61-8435-4b93ac57502a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jun 19 04:35:37 devstack cinder-volume[93769]: INFO cinder.volume.flows.manager.create_volume [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Volume volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed (0a23c333-6bb6-4954-bb9a-5022aa70bfed): created successfully Jun 19 04:35:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f217f99e-2107-4c61-8435-4b93ac57502a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=93769) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jun 19 04:35:37 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Flow 'volume_create_manager' (dce4eb1a-19b1-4842-b346-4020a790d93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=93769) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jun 19 04:35:37 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-9047b1f2-693c-4db4-bbed-11f887d1d2f7 tempest-SnapshotDependencyTests-83851385 None] Created volume successfully. Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "cinder-8e489af5-0190-4478-bd1e-4e0c193e924a-delete_snapshot" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-8e489af5-0190-4478-bd1e-4e0c193e924a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "cinder-quobyte-11e59cb9-423e-4f73-b502-4e9a0239aeef" by "delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-11e59cb9-423e-4f73-b502-4e9a0239aeef" acquired by "delete_snapshot" :: waited 0.013s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "cinder-quobyte-8e489af5-0190-4478-bd1e-4e0c193e924a" by "_delete_snapshot" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-8e489af5-0190-4478-bd1e-4e0c193e924a" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Deleting offline snapshot 8e489af5-0190-4478-bd1e-4e0c193e924a of volume 11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] snapshot_file for this snap is: volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a {{(pid=93769) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[575a8531-36e3-4929-8828-96613e5fb296]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:38 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:39 devstack sudo[114996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a Jun 19 04:35:39 devstack sudo[114996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:39 devstack sudo[114996]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a" returned: 0 in 0.734s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:39 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.remotefs [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-11e59cb9-423e-4f73-b502-4e9a0239aeef(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=93769) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jun 19 04:35:39 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6dab5b-e873-428b-8f57-00e04e98da37]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:39 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:39 devstack sudo[115001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef Jun 19 04:35:39 devstack sudo[115001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:40 devstack sudo[115001]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef" returned: 0 in 0.732s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:40 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:40 devstack sudo[115006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a Jun 19 04:35:40 devstack sudo[115006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:41 devstack sudo[115006]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a" returned: 0 in 0.698s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:41 devstack sudo[115012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a Jun 19 04:35:41 devstack sudo[115012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:41 devstack sudo[115012]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef.8e489af5-0190-4478-bd1e-4e0c193e924a" returned: 0 in 0.608s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-8e489af5-0190-4478-bd1e-4e0c193e924a" released by "_delete_snapshot" :: held 2.863s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-11e59cb9-423e-4f73-b502-4e9a0239aeef" released by "delete_snapshot" :: held 2.888s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Created reservations ['15c781f2-5f5e-4327-ac9a-fbff6aa6149f', '56afa640-7a8c-44c4-90eb-d79bf0dfeabd', 'd9810865-8580-406a-9352-2784b21f9fb1', 'a11a0f65-95be-45fa-944c-b6af9c9055a7'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:41 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Delete snapshot completed successfully. Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-aa5327ff-edfe-4c69-8151-b8c3ff8048c0 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-8e489af5-0190-4478-bd1e-4e0c193e924a-delete_snapshot" released by "delete_snapshot" :: held 3.008s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:41 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:41 devstack sudo[115016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:41 devstack sudo[115016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "cinder-11e59cb9-423e-4f73-b502-4e9a0239aeef-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-11e59cb9-423e-4f73-b502-4e9a0239aeef-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "cinder-quobyte-11e59cb9-423e-4f73-b502-4e9a0239aeef" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-11e59cb9-423e-4f73-b502-4e9a0239aeef" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfccadfc-54e0-4353-ad77-5dc7305e3293]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:42 devstack sudo[115019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef Jun 19 04:35:42 devstack sudo[115019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:42 devstack sudo[115016]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.674s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG oslo_service.periodic_task [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] Running periodic task VolumeManager._thread_info {{(pid=93769) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread count: 28 {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG cinder.volume.manager [None req-b9894627-4d2e-46bd-a95b-897a1290b759 None None] thread info: [<_MainThread(MainThread, started 134122322718848)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=93769) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jun 19 04:35:42 devstack sudo[115019]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef" returned: 0 in 0.757s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:42 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:42 devstack sudo[115025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef Jun 19 04:35:42 devstack sudo[115025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:43 devstack sudo[115025]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-11e59cb9-423e-4f73-b502-4e9a0239aeef" returned: 0 in 0.649s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:43 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-11e59cb9-423e-4f73-b502-4e9a0239aeef" released by "delete_volume" :: held 1.459s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:43 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Created reservations ['d16c1006-b915-4dda-a983-12aacb2e3749', 'd933e184-3b61-4ced-9773-376b994679e9', '37715e4c-59ab-4dfa-9277-a0baa876039a', 'f87442fe-1a7d-4024-86ad-228063accfbc'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:43 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:43 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:43 devstack sudo[115030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:43 devstack sudo[115030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "cinder-0a23c333-6bb6-4954-bb9a-5022aa70bfed-delete_volume" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-0a23c333-6bb6-4954-bb9a-5022aa70bfed-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "cinder-quobyte-0a23c333-6bb6-4954-bb9a-5022aa70bfed" by "delete_volume" {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jun 19 04:35:44 devstack sudo[115030]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.661s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:44 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-0a23c333-6bb6-4954-bb9a-5022aa70bfed" acquired by "delete_volume" :: waited 0.016s {{(pid=93769) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jun 19 04:35:44 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Deleted volume successfully. Jun 19 04:35:44 devstack cinder-volume[93769]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a5f11d2-d837-4e09-bf4f-e5d0fa1a36bc]: (4, 'qcow2') {{(pid=94763) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jun 19 04:35:44 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:44 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-d78e960c-86d0-445a-bb92-39b9697bd795 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-11e59cb9-423e-4f73-b502-4e9a0239aeef-delete_volume" released by "delete_volume" :: held 2.352s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:44 devstack sudo[115033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed Jun 19 04:35:44 devstack sudo[115033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:45 devstack sudo[115033]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed" returned: 0 in 0.733s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:45 devstack sudo[115038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed Jun 19 04:35:45 devstack sudo[115038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:45 devstack sudo[115038]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8/volume-0a23c333-6bb6-4954-bb9a-5022aa70bfed" returned: 0 in 0.645s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-quobyte-0a23c333-6bb6-4954-bb9a-5022aa70bfed" released by "delete_volume" :: held 1.429s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG cinder.quota [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Created reservations ['47c1d1e9-7e88-4746-97f9-8ce011087ea2', '2b0a53de-9513-4aa8-95bf-95dbfce4df67', '8ecd9388-940a-4a36-97d5-645aac103618', '793ee8bc-00be-4b8e-ad9b-4a73f9a7e57a'] {{(pid=93769) reserve /opt/stack/cinder/cinder/quota.py:752}} Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c': None} {{(pid=93769) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG cinder.volume.drivers.quobyte [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-850bbb56-e8f8-470b-8f69-6aaaaee1304c'] {{(pid=93769) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.lockutils [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=93769) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 19 04:35:45 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 19 04:35:45 devstack sudo[115041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8 Jun 19 04:35:45 devstack sudo[115041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jun 19 04:35:46 devstack sudo[115041]: pam_unix(sudo:session): session closed for user root Jun 19 04:35:46 devstack cinder-volume[93769]: DEBUG oslo_concurrency.processutils [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/b47f154c60b96e6c5370d80e305a1ba8" returned: 0 in 0.660s {{(pid=93769) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 19 04:35:46 devstack cinder-volume[93769]: DEBUG cinder.manager [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Notifying Schedulers of capabilities ... {{(pid=93769) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jun 19 04:35:46 devstack cinder-volume[93769]: INFO cinder.volume.manager [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Deleted volume successfully. Jun 19 04:35:46 devstack cinder-volume[93769]: DEBUG cinder.coordination [None req-f95bcc78-8d87-4796-a0c2-ab69a06dfaf5 tempest-SnapshotDependencyTests-83851385 None] Lock "cinder-0a23c333-6bb6-4954-bb9a-5022aa70bfed-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=93769) __release /opt/stack/cinder/cinder/coordination.py:152}} Jun 19 04:35:55 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:SELECT=80,cinder:UPDATE=139,cinder:INSERT=28,cinder:DELETE=5 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jun 19 04:35:56 devstack cinder-volume[93769]: DEBUG dbcounter [-] [93769] Writing DB stats cinder:UPDATE=114,cinder:INSERT=41,cinder:SELECT=97,cinder:DELETE=16 {{(pid=93769) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}